datahub

api

dataset cli - add support for schema, round-tripping to yaml (#12764 )

2025-03-04 10:17:51 -08:00

bigquery

dev: enable ruff rule (#12749 )

2025-02-28 17:49:52 +05:30

cli

dataset cli - add support for schema, round-tripping to yaml (#12764 )

2025-03-04 10:17:51 -08:00

config

feat(ingest): add strict_env_syntax mode to config loader (#12380 )

2025-01-17 14:26:00 -08:00

data_lake

feat(ingest/s3): add table filtering (#12661 )

2025-03-20 07:57:43 +01:00

datahub/emitter

feat(ingestion-tracing): implement ingestion with tracing api (#12714 )

2025-03-13 11:33:28 -05:00

dbt

feat(ingestion/dbt): Add include_database_name parameter for dbt core (#12411 )

2025-02-11 10:42:14 +01:00

dremio

fix(ingest/dremio): simplify and fix build source map (#12908 )

2025-03-21 11:31:16 +05:30

glue

fix(ingest/glue): Add additional checks and logging when specifying catalog_id (#12168 )

2024-12-24 14:56:35 -08:00

hex

feat(ingest): new hex connector - part 1 (#12915 )

2025-03-25 19:47:11 +01:00

patch

fix(py-sdk): DataJobPatchBuilder handling timestamps, output edges (#12067 )

2024-12-09 19:40:31 -05:00

redshift

feat(ingest/redshift): lineage for external schema created from redshift (#12826 )

2025-03-11 17:43:34 +05:30

reporting

chore(tableau): set ingestion stage report and perftimers (#12234 )

2025-01-09 19:04:37 +01:00

s3

refactor(ingest/s3): enhance readability (#12686 )

2025-02-28 14:19:46 +01:00

sagemaker

fix(ingest/snowflake): handle dots in snowflake table names (#12105 )

2024-12-12 15:31:32 +05:30

schema

dev: enable ruff rule (#12749 )

2025-02-28 17:49:52 +05:30

sdk

feat(ingestion-tracing): implement ingestion with tracing api (#12714 )

2025-03-13 11:33:28 -05:00

sdk_v2

feat(sdk): add support for institutional memory links (#12770 )

2025-03-04 08:45:01 -08:00

serde

feat(ingest): improve error messages for unknown metadata objects (#12745 )

2025-02-28 12:36:58 -08:00

snowflake

fix(ingest/snowflake): Fixing table rename query handling (#12852 )

2025-03-13 23:26:23 +01:00

sql_parsing

feat(ingest): improve extract-sql-agg-log command (#12803 )

2025-03-06 11:08:56 -08:00

stateful_ingestion

dev: remove black in favor of ruff for formatting (#12378 )

2025-01-18 15:06:20 +05:30

structured_properties

feat(sdk): structured properties - add support for listing (#12283 )

2025-01-09 07:32:22 -08:00

urns

dev: enable ruff rule (#12749 )

2025-02-28 17:49:52 +05:30

utilities

feat(cli): add extra pip and debug flag (#12621 )

2025-02-17 16:03:07 +05:30

__init__.py

…

test_athena_source.py

dev: enable ruff rule (#12749 )

2025-02-28 17:49:52 +05:30

test_aws_common.py

fix(ingest/aws_common): update tests execution on EC2 instance (#12252 )

2025-01-01 14:49:27 +05:30

test_business_glossary.py

feat(ingestion/business-glossary): Automatically generate predictable glossary term and node URNs when incompatible URL characters are specified in term and node names. (#12673 )

2025-03-06 14:30:10 +00:00

test_capability_report.py

…

test_cassandra_source.py

chore(ingest): bump black (#11898 )

2024-11-20 13:33:54 -08:00

test_classification.py

…

test_clickhouse_source.py

…

test_cockroach_source.py

…

test_compare_metadata.py

…

test_confluent_schema_registry.py

dev: remove black in favor of ruff for formatting (#12378 )

2025-01-18 15:06:20 +05:30

test_csv_enricher_source.py

…

test_datahub_source.py

…

test_druid_source.py

Fix platform instance support on Druid ingestion (#12716 )

2025-02-26 08:36:06 +01:00

test_elasticsearch_source.py

…

test_file_lineage_source.py

…

test_gc.py

fix(ingest/gc): logging and stopping fix (#12266 )

2025-01-03 22:15:52 +05:30

test_gcs_source.py

fix(ingestion): fix stateful ingestion for GCS source (#11879 )

2025-01-20 19:37:12 +05:30

test_ge_profiling_config.py

…

test_generic_aspect_transformer.py

chore(ingest): remove deprecated calls to Urn.create_from_string (#11983 )

2024-12-02 09:53:13 -08:00

test_hana_source.py

…

test_hive_source.py

…

test_iceberg.py

feat(ingestion/iceberg): Refactor iceberg source to use MCPWs instead of MCEs (#12912 )

2025-03-20 10:46:08 +01:00

test_kafka_sink.py

…

test_kafka_source.py

dev: enable ruff rule (#12749 )

2025-02-28 17:49:52 +05:30

test_ldap_source.py

…

test_mapping.py

…

test_mariadb_source.py

…

test_metabase_source.py

feat(ingest/metabase): API key support in Metabase source (#12711 )

2025-02-28 11:01:07 +05:30

test_mlflow_source.py

feat(ingest/mlflow): add dataset lineage (#12837 )

2025-03-21 08:38:43 +09:00

test_neo4j_source.py

feat(ingest): connector for Neo4j (#11526 )

2024-12-02 14:53:28 +05:30

test_nifi_source.py

…

test_openapi.py

[BREAKING CHANGE] fix(openapi): fixing openapi nesting (#12580 )

2025-02-18 06:05:54 -08:00

test_oracle_source.py

…

test_packages.py

feat(sdk): move version info to dedicated file (#12456 )

2025-01-24 11:35:39 -08:00

test_packaging.py

fix: fixes mypy complaints about pkgresources (#12790 )

2025-03-05 12:41:03 +01:00

test_postgres_source.py

dev: remove black in favor of ruff for formatting (#12378 )

2025-01-18 15:06:20 +05:30

test_powerbi_parser.py

refactor(ingest/powerbi): organize code within the module based on responsibilities (#11924 )

2024-11-27 09:32:24 -08:00

test_preset_source.py

feat(ingest): allowdenypattern for dashboard, chart, dataset in superset (#12782 )

2025-03-04 17:59:42 -05:00

test_protobuf_util.py

dev: enable ruff rule (#12749 )

2025-02-28 17:49:52 +05:30

test_pulsar_source.py

…

test_redash_source.py

fix(ingest): replace sqllineage/sqlparse with our SQL parser (#12020 )

2024-12-10 08:36:01 -08:00

test_rest_sink.py

dev: remove black in favor of ruff for formatting (#12378 )

2025-01-18 15:06:20 +05:30

test_schema_util.py

fix(ingestion): schema-metadata - fix jsonProps not being ingested for optional fields (#12927 )

2025-03-22 08:41:11 -07:00

test_source.py

…

test_sql_common.py

dev: enable ruff rule (#12749 )

2025-02-28 17:49:52 +05:30

test_sql_types.py

feat(ingest): standardize sql type mappings (#11982 )

2024-11-28 14:53:46 -05:00

test_sql_utils.py

…

test_superset_source.py

feat(ingestion/superset): superset column level lineage (#12786 )

2025-03-14 08:02:54 -07:00

test_tableau_source.py

feat(tableau): fine-grained page size (#12354 )

2025-01-16 16:43:46 +01:00

test_transform_dataset.py

fix(ingest): handle groups in pattern_cleanup_ownership transformer (#12536 )

2025-02-24 14:47:46 -08:00

test_unity_catalog_config.py

…

test_usage_common.py

fix(ingest): consistent fingerprint for sql parsing aggregator (#12239 )

2025-01-03 10:49:42 -08:00

test_vertexai_source.py

feat(ingestion) Adding vertexAI ingestion source (v2 - experiment and experiment run) (#12836 )

2025-03-21 14:06:17 -07:00

test_vertica_source.py

…