datahub

abs

fix(ingestion/abs): updated deprecated azure sdk parameter to supported parameter and uri prefix support of https (#14106 )

2025-07-16 18:44:31 +01:00

api

Adding support for domains when upserting datasets with the cli (#14152 )

2025-07-24 17:35:17 -04:00

autogenerated

fix(ingest): better experimental contract (#14071 )

2025-07-14 19:45:55 +05:30

bigquery

chore(ingest): simplify MetadataChangeProposalWrapper usages (#14019 )

2025-07-10 08:45:01 -07:00

cli

fix(quickstart): update commit hash with resolved quickstart profile (#14089 )

2025-07-15 22:19:29 +05:30

config

chore(python): drop python 3.8 follow ups (#14004 )

2025-07-09 13:24:33 +05:30

data_lake

fix(ingestion/abs): align add_partition_columns_to_schema functionality with working s3/gcs functionality in abs connector (#14153 )

2025-07-22 18:36:17 +01:00

datahub/emitter

chore(ingest): simplify MetadataChangeProposalWrapper usages (#14019 )

2025-07-10 08:45:01 -07:00

dbt

feat(ingest/dbt): add drop_duplicate_sources flag (#14161 )

2025-07-23 22:05:35 -07:00

dremio

feat(dremio): add configurable time range for query lineage extraction, sql aggregator report and fix schema_pattern filtering (#13613 )

2025-06-26 15:28:42 +02:00

glue

chore(python): drop python 3.8 follow ups (#14004 )

2025-07-09 13:24:33 +05:30

grafana

feat(ingestion/grafana): Add datasets and charts to dashboards with lineage and tags. Lineage back to source (#12417 )

2025-07-24 17:05:09 +01:00

hex

feat(hex): add retry logic with exponential backoff for 429 rate limiting (#13905 )

2025-07-03 11:12:31 +02:00

mock_data

feat(ingest/mock-data): misc changes (#14133 )

2025-07-18 14:20:23 +05:30

patch

tests(ingestion): moving some tests so they are available for sdk users (#13540 )

2025-05-19 08:39:53 +02:00

powerbi

feat(ingest/powerbi): Support ODBC Data Source (#13090 )

2025-04-10 08:57:37 -05:00

redshift

feat(ingest/sql): column logic + join extraction (#13426 )

2025-05-12 17:19:44 -07:00

reporting

feat(dremio): add configurable time range for query lineage extraction, sql aggregator report and fix schema_pattern filtering (#13613 )

2025-06-26 15:28:42 +02:00

s3

fix(ingest/s3): Fix ingestion when path_spec had a wildcard character in the path (#13940 )

2025-07-07 13:12:21 +02:00

sagemaker

tests(ingestion): moving some tests so they are available for sdk users (#13540 )

2025-05-19 08:39:53 +02:00

schema

dev: enable ruff rule (#12749 )

2025-02-28 17:49:52 +05:30

sdk

feat(sdk): add data products to suggested entity type filters (#14159 )

2025-07-22 08:23:59 -07:00

sdk_v2

fix(sdk): make Filter type parsing more permissive (#14212 )

2025-07-25 09:37:23 -07:00

serde

refactor(ingest/tableau): cleanup duplicate lineage calls (#14018 )

2025-07-10 21:06:09 -07:00

snowflake

fix(snowflake): correct additional_database_names OR logic in access_history filter (#14104 )

2025-07-16 12:10:12 +02:00

sql_parsing

feat(sql-parsing-aggregator): add override_dialect for observed query (#14201 )

2025-07-25 08:21:44 +02:00

sql_queries

fix(ingest/sql-queries): handle string timestamps and empty table names (#14205 )

2025-07-25 22:33:49 +02:00

stateful_ingestion

chore(python): drop python 3.8 follow ups (#14004 )

2025-07-09 13:24:33 +05:30

stored_procedure

tests(ingestion): moving some tests so they are available for sdk users (#13540 )

2025-05-19 08:39:53 +02:00

structured_properties

fix(cli): strictly validate structured property values (#13576 )

2025-05-21 08:36:50 -07:00

tableau

Update test_tableau_source.py

2025-07-30 18:17:26 +01:00

urns

dev: enable ruff rule (#12749 )

2025-02-28 17:49:52 +05:30

utilities

chore(python): drop python 3.8 follow ups (#14004 )

2025-07-09 13:24:33 +05:30

__init__.py

…

test_athena_properties_extractor.py

feat(ingest/athena): Iceberg partition columns extraction (#13607 )

2025-07-07 14:46:40 +02:00

test_athena_source.py

fix(ingest/athena): Make Athena simple column v1 conversion optional (#14112 )

2025-07-17 09:15:48 +02:00

test_aws_common.py

fix(ingest/aws_common): update tests execution on EC2 instance (#12252 )

2025-01-01 14:49:27 +05:30

test_business_glossary.py

feat(ingestion/business-glossary): Automatically generate predictable glossary term and node URNs when incompatible URL characters are specified in term and node names. (#12673 )

2025-03-06 14:30:10 +00:00

test_capability_report.py

…

test_cassandra_source.py

chore(python): drop python 3.8 follow ups (#14004 )

2025-07-09 13:24:33 +05:30

test_classification_mixin.py

fix(snowflake summary): fixing snowflake summary source (#13785 )

2025-06-17 19:17:09 -04:00

test_classification.py

…

test_clickhouse_source.py

…

test_cockroach_source.py

feat(ingest/cockroachdb): add cockroachdb ingestion (#10226 )

2024-04-09 18:36:51 -07:00

test_compare_metadata.py

tests(ingestion): moving some tests so they are available for sdk users (#13540 )

2025-05-19 08:39:53 +02:00

test_confluent_schema_registry.py

fix(ingest/bigquery): Set qualified name for bigquery containers (#13747 )

2025-06-12 05:53:59 +02:00

test_csv_enricher_source.py

…

test_datahub_source.py

fix(ingest/datahub): Create Structured property templates in advance and batch processing (#13355 )

2025-05-26 14:05:17 +02:00

test_druid_source.py

Fix platform instance support on Druid ingestion (#12716 )

2025-02-26 08:36:06 +01:00

test_elasticsearch_source.py

feat(ingest): fix validators (#10115 )

2024-03-27 15:20:55 -07:00

test_file_lineage_source.py

feat(ingest): fix validators (#10115 )

2024-03-27 15:20:55 -07:00

test_gc.py

chore(python): drop python 3.8 follow ups (#14004 )

2025-07-09 13:24:33 +05:30

test_gcs_source.py

fix(ingest/gcs): Fix GCS URI mismatch causing file filtering during ingestion (#14006 )

2025-07-09 22:22:22 +02:00

test_ge_profiling_config.py

…

test_generic_aspect_transformer.py

chore(ingest): remove calls to deprecated methods (#13009 )

2025-03-28 13:42:54 -07:00

test_hana_source.py

…

test_hive_source.py

…

test_iceberg.py

feat(ingestion/iceberg): Add capability to extract namespace properties to the iceberg ingestor (#13238 )

2025-04-17 16:29:43 +02:00

test_kafka_connect.py

feat(ingest/kafka-connect): Add more connectors the regexp transformation support (#13748 )

2025-07-03 08:57:50 +02:00

test_kafka_sink.py

…

test_kafka_source.py

fix(ingest/bigquery): Set qualified name for bigquery containers (#13747 )

2025-06-12 05:53:59 +02:00

test_ldap_source.py

…

test_mapping.py

fix(ingest/dbt): Fix urn validation in ownership type check (#13563 )

2025-05-21 13:02:26 +02:00

test_mariadb_source.py

…

test_metabase_source.py

feat(ingest/metabase): API key support in Metabase source (#12711 )

2025-02-28 11:01:07 +05:30

test_mlflow_source.py

feat(ingest/mlflow): add dataset lineage (#12837 )

2025-03-21 08:38:43 +09:00

test_mssql.py

chore(python): drop python 3.8 follow ups (#14004 )

2025-07-09 13:24:33 +05:30

test_neo4j_source.py

feat(ingestion/neo4j): Add stateful_ingestion and platform_instance capabilities to connector (#12631 )

2025-04-26 11:52:20 +01:00

test_nifi_source.py

chore(python): drop python 3.8 follow ups (#14004 )

2025-07-09 13:24:33 +05:30

test_openapi.py

[BREAKING CHANGE] fix(openapi): fixing openapi nesting (#12580 )

2025-02-18 06:05:54 -08:00

test_oracle_source.py

fix(ingest/oracle): fix scheme for sqlalchemy < 2 (#11829 )

2024-11-14 12:46:27 +05:30

test_packages.py

feat(sdk): move version info to dedicated file (#12456 )

2025-01-24 11:35:39 -08:00

test_packaging.py

fix: fixes mypy complaints about pkgresources (#12790 )

2025-03-05 12:41:03 +01:00

test_postgres_source.py

dev: remove black in favor of ruff for formatting (#12378 )

2025-01-18 15:06:20 +05:30

test_powerbi_parser.py

refactor(ingest/powerbi): organize code within the module based on responsibilities (#11924 )

2024-11-27 09:32:24 -08:00

test_preset_source.py

feat(ingest): filter by database in superset and preset (#13409 )

2025-05-09 09:51:59 -04:00

test_protobuf_util.py

dev: enable ruff rule (#12749 )

2025-02-28 17:49:52 +05:30

test_pulsar_source.py

fix(ingestion): use default generate_browse_path_v2 even if no pipeline_config (#13117 )

2025-04-23 13:25:58 +02:00

test_redash_source.py

fix(ingest): replace sqllineage/sqlparse with our SQL parser (#12020 )

2024-12-10 08:36:01 -08:00

test_rest_sink.py

feat(ingestion): refactor api-tracing EmitMode (#13397 )

2025-05-05 10:54:31 -05:00

test_schema_util.py

fix(ingest/avro): expand record fields consistently in arrays, maps, and direct references (#13961 )

2025-07-10 11:00:59 +02:00

test_source.py

fix(ingest/report): fix bug w.r.t. aspect count (#14070 )

2025-07-14 16:17:16 +05:30

test_sql_common.py

feat(ingestion/sql-common): add column level lineage for external tables (#11997 )

2025-06-04 13:24:44 +01:00

test_sql_types.py

fix(ingest/dbt): Fix urn validation in ownership type check (#13563 )

2025-05-21 13:02:26 +02:00

test_sql_utils.py

fix(ingest/profiling): Filter tables early based on profile pattern filter (#10378 )

2024-04-26 17:35:03 +02:00

test_superset_source.py

feat(ingest): filter by database in superset and preset (#13409 )

2025-05-09 09:51:59 -04:00

test_teradata_integration.py

chore(ingest/teradata): fix lint errors (#14055 )

2025-07-11 13:01:10 -07:00

test_teradata_performance.py

chore(ingest/teradata): fix lint errors (#14055 )

2025-07-11 13:01:10 -07:00

test_teradata_source.py

chore(ingest/teradata): fix lint errors (#14055 )

2025-07-11 13:01:10 -07:00

test_transform_dataset.py

chore(ingest): simplify MetadataChangeProposalWrapper usages (#14019 )

2025-07-10 08:45:01 -07:00

test_unity_catalog_config.py

fix(ingest/databricks): handle and report config parse failure, updat… (#10261 )

2024-04-17 12:14:16 -07:00

test_usage_common.py

chore(ingest): remove calls to deprecated methods (#13009 )

2025-03-28 13:42:54 -07:00

test_vertexai_source.py

VertexAI Connector (v3 - pipeline and pipeline task) (#12960 )

2025-04-10 22:54:17 -07:00

test_vertica_source.py

…