datahub

abs

fix(ingestion/abs): updated deprecated azure sdk parameter to supported parameter and uri prefix support of https (#14106 )

2025-07-16 18:44:31 +01:00

api

feat(dataproduct): output ports (#15000 )

2025-10-14 15:49:04 +02:00

autogenerated

fix(ingest): better experimental contract (#14071 )

2025-07-14 19:45:55 +05:30

bigquery

feat(bigquery): add created and modified timestamps to dataset containers (#14716 )

2025-09-15 18:24:58 +02:00

cli

feat(cli): add user add command (#15011 )

2025-10-16 20:36:59 +05:30

config

chore(python): drop python 3.8 follow ups (#14004 )

2025-07-09 13:24:33 +05:30

data_lake

feat(s3/ingest): performance improvements for get_dir_to_process and get_folder_info (#14709 )

2025-10-02 15:51:02 +02:00

datahub

fix(ingest): only add to samples where platform match (#14722 )

2025-09-11 13:26:39 +05:30

dbt

feat(ingestion/dbt): allow for dbt resources to be secondaries in sibling relationship on switch (#13230 )

2025-08-22 07:32:18 +01:00

dremio

feat(dremio): add configurable time range for query lineage extraction, sql aggregator report and fix schema_pattern filtering (#13613 )

2025-06-26 15:28:42 +02:00

excel

feat(ingest/excel): Add Excel Source (#13261 )

2025-08-28 08:03:37 +00:00

glue

fix(ingest/unity-catalog): Speed up tag extraction by caching platform resources (#14376 )

2025-08-11 22:51:25 +02:00

grafana

feat(ingestion/grafana): Add datasets and charts to dashboards with lineage and tags. Lineage back to source (#12417 )

2025-07-24 17:05:09 +01:00

hex

chore(python): drop pydantic v1 support (#14014 )

2025-09-23 07:40:29 +00:00

looker

fix(ingest/looker): Ignore fields with empty column name to not generate invalid field urns (#14338 )

2025-08-12 08:55:14 +02:00

lookml

feat(ingestion): Enhanced column lineage extraction for Looker/LookML (#14826 )

2025-09-26 09:27:18 -07:00

mock_data

feat(ingest/mock-data): misc changes (#14133 )

2025-07-18 14:20:23 +05:30

patch

feat(ingestion/dbt): allow for dbt resources to be secondaries in sibling relationship on switch (#13230 )

2025-08-22 07:32:18 +01:00

powerbi

feat(ingest/powerbi): Add ODBC SQL query parsing with DSN-to-database/schema mapping (#13752 )

2025-08-27 15:25:23 +05:30

redshift

refactor(ingestion): renamed redshift lineage_v2 to lineage and other v2 nomenclatures (#14603 )

2025-08-29 11:37:26 -07:00

reporting

fix(ingest): serialisation of structured report (#14973 )

2025-10-10 19:29:56 +05:30

s3

feat(s3/ingest): performance improvements for get_dir_to_process and get_folder_info (#14709 )

2025-10-02 15:51:02 +02:00

sagemaker

tests(ingestion): moving some tests so they are available for sdk users (#13540 )

2025-05-19 08:39:53 +02:00

schema

fix(ingestion/mongodb): Fix handling of arrays containing complex structures (#15026 )

2025-10-17 18:49:05 +02:00

sdk

feat(sdk): add data products to suggested entity type filters (#14159 )

2025-07-22 08:23:59 -07:00

sdk_v2

feat(sdk/search): add tags, glossary terms filter (#14873 )

2025-09-29 06:31:39 +00:00

secret

feat(secret): FileSecretStore and EnvironmentSecretStore (#14882 )

2025-09-30 07:30:56 +00:00

serde

refactor(sdk): extract env variables into a single file (#15021 )

2025-10-16 19:04:43 +05:30

snowflake

feat(ingest/snowfle,bigquery): Stateful time window ingestion for queries v2 with bucket alignment (#15040 )

2025-10-22 11:16:50 +02:00

sql_parsing

fix(ingest): Handle empty column names in SQL parsing column lineage (#15013 )

2025-10-22 16:09:32 +00:00

sql_queries

feat(ingestion/sql-queries): support incremental lineage (#14548 )

2025-08-26 10:02:40 +01:00

stateful_ingestion

feat(ingest/snowfle,bigquery): Stateful time window ingestion for queries v2 with bucket alignment (#15040 )

2025-10-22 11:16:50 +02:00

stored_procedure

tests(ingestion): moving some tests so they are available for sdk users (#13540 )

2025-05-19 08:39:53 +02:00

structured_properties

fix(cli): strictly validate structured property values (#13576 )

2025-05-21 08:36:50 -07:00

tableau

Update test_tableau_virtual_connections.py

2025-10-26 20:16:31 +00:00

transformers

feature(transformers): Introduce Set browsePathsV2 transformer (#14825 )

2025-09-23 19:20:01 +00:00

urns

dev: enable ruff rule (#12749 )

2025-02-28 17:49:52 +05:30

utilities

fix(ingestion): Fix for module level variable caching in sqllite check (#14861 )

2025-09-26 14:24:51 +02:00

__init__.py

…

test_athena_properties_extractor.py

feat(ingest/athena): Iceberg partition columns extraction (#13607 )

2025-07-07 14:46:40 +02:00

test_athena_source.py

fix(ingest/athena): Fix Athena partition extraction and CONCAT function type issues (#14712 )

2025-09-10 12:33:54 +02:00

test_aws_common.py

feat(s3): support wildcards in bucket name component of path_specs (#14549 )

2025-08-26 16:29:52 -04:00

test_business_glossary.py

feat(ingestion/business-glossary): Automatically generate predictable glossary term and node URNs when incompatible URL characters are specified in term and node names. (#12673 )

2025-03-06 14:30:10 +00:00

test_capability_report.py

…

test_cassandra_source.py

chore(python): drop python 3.8 follow ups (#14004 )

2025-07-09 13:24:33 +05:30

test_classification_mixin.py

fix(snowflake summary): fixing snowflake summary source (#13785 )

2025-06-17 19:17:09 -04:00

test_classification.py

feat(classifier): Add support for excluding list of exact column names (#9472 )

2024-01-16 19:12:23 -08:00

test_clickhouse_source.py

…

test_cockroach_source.py

feat(ingest/cockroachdb): add cockroachdb ingestion (#10226 )

2024-04-09 18:36:51 -07:00

test_compare_metadata.py

tests(ingestion): moving some tests so they are available for sdk users (#13540 )

2025-05-19 08:39:53 +02:00

test_confluent_schema_registry.py

fix(ingest/bigquery): Set qualified name for bigquery containers (#13747 )

2025-06-12 05:53:59 +02:00

test_csv_enricher_source.py

feat(ingest/csv-enricher): add support for ownership type urn (#9935 )

2024-02-27 17:47:04 +00:00

test_datahub_source.py

fix(ingestion): updated json_extract function for postgres db #12604 (#14533 )

2025-08-21 15:42:51 -07:00

test_druid_source.py

Fix platform instance support on Druid ingestion (#12716 )

2025-02-26 08:36:06 +01:00

test_elasticsearch_source.py

feat(ingest): fix validators (#10115 )

2024-03-27 15:20:55 -07:00

test_file_lineage_source.py

feat(ingest): fix validators (#10115 )

2024-03-27 15:20:55 -07:00

test_gc.py

chore(python): drop python 3.8 follow ups (#14004 )

2025-07-09 13:24:33 +05:30

test_gcs_source.py

fix(ingest/gcs): Fix GCS URI mismatch causing file filtering during ingestion (#14006 )

2025-07-09 22:22:22 +02:00

test_ge_profiling_config.py

…

test_generic_aspect_transformer.py

chore(ingest): remove calls to deprecated methods (#13009 )

2025-03-28 13:42:54 -07:00

test_hana_source.py

…

test_hive_source.py

…

test_iceberg.py

chore(iceberg): bump dependency (#15001 )

2025-10-14 14:33:31 +00:00

test_kafka_connect.py

fix(mongo-source): Add failing test for complex topic name parsing (#15002 )

2025-10-16 18:48:02 +05:30

test_kafka_sink.py

…

test_kafka_source.py

fix(ingest/bigquery): Set qualified name for bigquery containers (#13747 )

2025-06-12 05:53:59 +02:00

test_ldap_source.py

…

test_mapping.py

feat(meta-mappping): support meta mappings of lists (#14306 )

2025-08-01 12:26:45 -07:00

test_mariadb_source.py

…

test_metabase_source.py

feat(ingest/metabase): API key support in Metabase source (#12711 )

2025-02-28 11:01:07 +05:30

test_mlflow_source.py

feat(ingest/mlflow): add dataset lineage (#12837 )

2025-03-21 08:38:43 +09:00

test_mongodb_source.py

fix(ingestion/mongodb): Fix handling of arrays containing complex structures (#15026 )

2025-10-17 18:49:05 +02:00

test_mssql.py

chore(python): drop python 3.8 follow ups (#14004 )

2025-07-09 13:24:33 +05:30

test_mysql_rds_iam.py

feat(ingest/postgres,mysql): Add iam auth support for MySql and Postgresql source (#14899 )

2025-10-21 08:33:39 +02:00

test_neo4j_source.py

feat(ingest/neo4j): migrate Neo4j source to DataHub Python SDK v2 (#14591 )

2025-09-15 08:42:54 +00:00

test_nifi_source.py

chore(python): drop python 3.8 follow ups (#14004 )

2025-07-09 13:24:33 +05:30

test_openapi.py

[BREAKING CHANGE] fix(openapi): fixing openapi nesting (#12580 )

2025-02-18 06:05:54 -08:00

test_oracle_source.py

fix(ingest/oracle): fix scheme for sqlalchemy < 2 (#11829 )

2024-11-14 12:46:27 +05:30

test_packages.py

feat(sdk): move version info to dedicated file (#12456 )

2025-01-24 11:35:39 -08:00

test_packaging.py

fix: fixes mypy complaints about pkgresources (#12790 )

2025-03-05 12:41:03 +01:00

test_postgres_rds_iam.py

feat(ingest/postgres,mysql): Add iam auth support for MySql and Postgresql source (#14899 )

2025-10-21 08:33:39 +02:00

test_postgres_source.py

dev: remove black in favor of ruff for formatting (#12378 )

2025-01-18 15:06:20 +05:30

test_powerbi_parser.py

refactor(ingest/powerbi): organize code within the module based on responsibilities (#11924 )

2024-11-27 09:32:24 -08:00

test_preset_source.py

feat(ingest): filter by database in superset and preset (#13409 )

2025-05-09 09:51:59 -04:00

test_protobuf_util.py

dev: enable ruff rule (#12749 )

2025-02-28 17:49:52 +05:30

test_pulsar_source.py

chore(python): drop pydantic v1 support (#14014 )

2025-09-23 07:40:29 +00:00

test_rds_iam_utils.py

feat(ingest/postgres,mysql): Add iam auth support for MySql and Postgresql source (#14899 )

2025-10-21 08:33:39 +02:00

test_redash_source.py

fix(ingest): change redash sql parse error to warnining (#14785 )

2025-09-17 08:06:15 -04:00

test_rest_sink.py

feat(ingestion): refactor api-tracing EmitMode (#13397 )

2025-05-05 10:54:31 -05:00

test_schema_util.py

fix(ingest/avro): expand record fields consistently in arrays, maps, and direct references (#13961 )

2025-07-10 11:00:59 +02:00

test_source.py

fix(ingest): only add to samples where platform match (#14722 )

2025-09-11 13:26:39 +05:30

test_sql_common.py

feat(ingestion/sql-common): add column level lineage for external tables (#11997 )

2025-06-04 13:24:44 +01:00

test_sql_types.py

feat(ingest/neo4j): migrate Neo4j source to DataHub Python SDK v2 (#14591 )

2025-09-15 08:42:54 +00:00

test_sql_utils.py

fix(ingest/profiling): Filter tables early based on profile pattern filter (#10378 )

2024-04-26 17:35:03 +02:00

test_superset_source.py

feat(superset/preset): add column-level-lineage support for aggregate charts (#14242 )

2025-08-12 09:17:10 +02:00

test_teradata_integration.py

fix(ingest/teradata): Fix Teradata lineage URN generation to prevent extra database prefixes (#14715 )

2025-10-15 12:29:26 +02:00

test_teradata_performance.py

fix(ingest/teradata): Fix Teradata lineage URN generation to prevent extra database prefixes (#14715 )

2025-10-15 12:29:26 +02:00

test_teradata_source.py

fix(ingest/teradata): Fix Teradata lineage URN generation to prevent extra database prefixes (#14715 )

2025-10-15 12:29:26 +02:00

test_transform_dataset.py

fix(ingest): only add to samples where platform match (#14722 )

2025-09-11 13:26:39 +05:30

test_unity_catalog_config.py

feat(ingest/unity): Use sql to extract query history for usage (#14953 )

2025-10-15 10:46:59 +02:00

test_unity_catalog_proxy.py

feat(ingest/unity): Use sql to extract query history for usage (#14953 )

2025-10-15 10:46:59 +02:00

test_unity_catalog_source.py

feat(ingest/unity): Use sql to extract query history for usage (#14953 )

2025-10-15 10:46:59 +02:00

test_unity_catalog_tag_entities.py

fix(ingest/unity-catalog): Speed up tag extraction by caching platform resources (#14376 )

2025-08-11 22:51:25 +02:00

test_usage_common.py

feat(ingest): respect user email pattern in usage aggregator (#14562 )

2025-09-03 23:34:42 +00:00

test_user_add.py

feat(cli): add user add command (#15011 )

2025-10-16 20:36:59 +05:30

test_vertexai_source.py

VertexAI Connector (v3 - pipeline and pipeline task) (#12960 )

2025-04-10 22:54:17 -07:00

test_vertica_source.py

…