datahub

abs

fix(ingestion/abs): updated deprecated azure sdk parameter to supported parameter and uri prefix support of https (#14106 )

2025-07-16 18:44:31 +01:00

api

refactor(pydantic): remove Pydantic v1 legacy code and migrate fully to v2 (#15261 )

2025-11-12 09:57:06 +00:00

autogenerated

fix(ingest): better experimental contract (#14071 )

2025-07-14 19:45:55 +05:30

bigquery

chore: Remove Pydantic V1 deprecation warnings (#15057 )

2025-11-05 14:31:43 +00:00

cli

feat(ingestion): Add secret masking framework (#15188 )

2025-11-12 22:22:37 -08:00

config

feat(ingestion): Add secret masking framework (#15188 )

2025-11-12 22:22:37 -08:00

configuration

feat(config): Hide input data in validation errors when DATAHUB_DEBUG is disabled (#15345 )

2025-11-19 10:34:30 -08:00

data_lake

chore: Remove Pydantic V1 deprecation warnings (#15057 )

2025-11-05 14:31:43 +00:00

datahub

fix(ingest): only add to samples where platform match (#14722 )

2025-09-11 13:26:39 +05:30

dbt

feat(dbt): enhance DBTCloud integration with bulk job ingestion (#15264 )

2025-11-13 11:55:08 -08:00

dremio

fix(ingestion/dremio): handle dremio oom errors when ingesting large amount of metadata (#14883 )

2025-10-27 15:52:51 +00:00

excel

feat(ingest/excel): Add Excel Source (#13261 )

2025-08-28 08:03:37 +00:00

fivetran

feat(fivetran/google_sheets): add Google Sheets support and API client integration (#15007 )

2025-10-23 14:32:49 -07:00

glue

chore: Remove Pydantic V1 deprecation warnings (#15057 )

2025-11-05 14:31:43 +00:00

grafana

fix: allow for non-tagged assets in Grafana (#15300 )

2025-11-15 09:51:05 +05:30

hex

chore: Remove Pydantic V1 deprecation warnings (#15057 )

2025-11-05 14:31:43 +00:00

looker

fix(ingest/looker): Ignore fields with empty column name to not generate invalid field urns (#14338 )

2025-08-12 08:55:14 +02:00

lookml

refactor(lookml): Fixed log levels for source reporters (#15318 )

2025-11-18 08:10:35 +00:00

mock_data

feat(ingest/mock-data): misc changes (#14133 )

2025-07-18 14:20:23 +05:30

patch

feat(ingestion/dbt): allow for dbt resources to be secondaries in sibling relationship on switch (#13230 )

2025-08-22 07:32:18 +01:00

powerbi

chore: Remove Pydantic V1 deprecation warnings (#15057 )

2025-11-05 14:31:43 +00:00

redshift

refactor(ingestion): renamed redshift lineage_v2 to lineage and other v2 nomenclatures (#14603 )

2025-08-29 11:37:26 -07:00

reporting

chore: Remove Pydantic V1 deprecation warnings (#15057 )

2025-11-05 14:31:43 +00:00

s3

feat(ingestion): Make PySpark optional for S3 (#15123 )

2025-11-19 12:11:40 +00:00

sagemaker

tests(ingestion): moving some tests so they are available for sdk users (#13540 )

2025-05-19 08:39:53 +02:00

schema

fix(ingestion/mongodb): Fix handling of arrays containing complex structures (#15026 )

2025-10-17 18:49:05 +02:00

sdk

chore: Remove Pydantic V1 deprecation warnings (#15057 )

2025-11-05 14:31:43 +00:00

sdk_v2

refactor(pydantic): remove Pydantic v1 legacy code and migrate fully to v2 (#15261 )

2025-11-12 09:57:06 +00:00

secret

feat(secret): FileSecretStore and EnvironmentSecretStore (#14882 )

2025-09-30 07:30:56 +00:00

serde

refactor(sdk): extract env variables into a single file (#15021 )

2025-10-16 19:04:43 +05:30

snowflake

feat(ingest/snowflake): add Streamlit apps ingestion support (#15272 )

2025-11-11 11:43:35 -08:00

sql_parsing

fix(ingest): Handle empty column names from Snowflake access history (#15106 )

2025-11-03 10:52:48 -08:00

sql_queries

chore: Remove Pydantic V1 deprecation warnings (#15057 )

2025-11-05 14:31:43 +00:00

stateful_ingestion

refactor(pydantic): remove Pydantic v1 legacy code and migrate fully to v2 (#15261 )

2025-11-12 09:57:06 +00:00

stored_procedure

tests(ingestion): moving some tests so they are available for sdk users (#13540 )

2025-05-19 08:39:53 +02:00

structured_properties

fix(cli): strictly validate structured property values (#13576 )

2025-05-21 08:36:50 -07:00

tableau

Update test_tableau_virtual_connections.py

2025-11-20 18:45:55 +00:00

transformers

feature(transformers): Introduce Set browsePathsV2 transformer (#14825 )

2025-09-23 19:20:01 +00:00

urns

dev: enable ruff rule (#12749 )

2025-02-28 17:49:52 +05:30

utilities

fix(ingestion): Fix for module level variable caching in sqllite check (#14861 )

2025-09-26 14:24:51 +02:00

__init__.py

…

test_athena_properties_extractor.py

feat(ingest/athena): Iceberg partition columns extraction (#13607 )

2025-07-07 14:46:40 +02:00

test_athena_source.py

refactor(pydantic): remove Pydantic v1 legacy code and migrate fully to v2 (#15261 )

2025-11-12 09:57:06 +00:00

test_aws_common.py

fix(ingest/aws): Fix for the aws credential caching (#15278 )

2025-11-17 16:49:33 +01:00

test_bootstrap.py

feat(ingestion): Add secret masking framework (#15188 )

2025-11-12 22:22:37 -08:00

test_business_glossary.py

feat(ingestion/business-glossary): Automatically generate predictable glossary term and node URNs when incompatible URL characters are specified in term and node names. (#12673 )

2025-03-06 14:30:10 +00:00

test_capability_report.py

…

test_cassandra_source.py

chore: Remove Pydantic V1 deprecation warnings (#15057 )

2025-11-05 14:31:43 +00:00

test_classification_mixin.py

fix(snowflake summary): fixing snowflake summary source (#13785 )

2025-06-17 19:17:09 -04:00

test_classification.py

chore: Remove Pydantic V1 deprecation warnings (#15057 )

2025-11-05 14:31:43 +00:00

test_clickhouse_source.py

chore: Remove Pydantic V1 deprecation warnings (#15057 )

2025-11-05 14:31:43 +00:00

test_cockroach_source.py

chore: Remove Pydantic V1 deprecation warnings (#15057 )

2025-11-05 14:31:43 +00:00

test_compare_metadata.py

tests(ingestion): moving some tests so they are available for sdk users (#13540 )

2025-05-19 08:39:53 +02:00

test_confluent_schema_registry.py

chore: Remove Pydantic V1 deprecation warnings (#15057 )

2025-11-05 14:31:43 +00:00

test_csv_enricher_source.py

feat(ingest/csv-enricher): add support for ownership type urn (#9935 )

2024-02-27 17:47:04 +00:00

test_datahub_source.py

fix(ingestion): updated json_extract function for postgres db #12604 (#14533 )

2025-08-21 15:42:51 -07:00

test_druid_source.py

chore: Remove Pydantic V1 deprecation warnings (#15057 )

2025-11-05 14:31:43 +00:00

test_elasticsearch_source.py

chore: Remove Pydantic V1 deprecation warnings (#15057 )

2025-11-05 14:31:43 +00:00

test_exception_hook.py

feat(ingestion): Add secret masking framework (#15188 )

2025-11-12 22:22:37 -08:00

test_file_lineage_source.py

chore: Remove Pydantic V1 deprecation warnings (#15057 )

2025-11-05 14:31:43 +00:00

test_gc.py

chore(python): drop python 3.8 follow ups (#14004 )

2025-07-09 13:24:33 +05:30

test_gcs_source.py

fix(ingest/gcs): Fix GCS URI mismatch causing file filtering during ingestion (#14006 )

2025-07-09 22:22:22 +02:00

test_ge_profiling_config.py

chore: Remove Pydantic V1 deprecation warnings (#15057 )

2025-11-05 14:31:43 +00:00

test_generic_aspect_transformer.py

chore(ingest): remove calls to deprecated methods (#13009 )

2025-03-28 13:42:54 -07:00

test_hana_source.py

chore: Remove Pydantic V1 deprecation warnings (#15057 )

2025-11-05 14:31:43 +00:00

test_hive_source.py

chore: Remove Pydantic V1 deprecation warnings (#15057 )

2025-11-05 14:31:43 +00:00

test_iceberg.py

fix(ingest/iceberg): Extend iceberg source to allow role assumption (#15288 )

2025-11-17 12:26:43 +01:00

test_kafka_connect_cloud_validation.py

feat(ingest/kafka-connect): Add Confluent Cloud connector and transform pipeline support (#14575 )

2025-11-18 12:17:43 +01:00

test_kafka_connect_consumer_group_analyzer.py

feat(ingest/kafka-connect): Add Confluent Cloud connector and transform pipeline support (#14575 )

2025-11-18 12:17:43 +01:00

test_kafka_connect_topic_cache.py

feat(ingest/kafka-connect): Add Confluent Cloud connector and transform pipeline support (#14575 )

2025-11-18 12:17:43 +01:00

test_kafka_connect.py

feat(ingest/kafka-connect): Add Confluent Cloud connector and transform pipeline support (#14575 )

2025-11-18 12:17:43 +01:00

test_kafka_sink.py

…

test_kafka_source.py

chore: Remove Pydantic V1 deprecation warnings (#15057 )

2025-11-05 14:31:43 +00:00

test_ldap_source.py

fix(ldap): properly handle escaped characters in LDAP DNs (#7928 )

2023-05-03 13:57:52 -07:00

test_library_examples.py

feat(docs): enhance metadata model entity documentation with field tables and SDK examples (#15095 )

2025-10-23 14:01:45 -07:00

test_logging_utils.py

feat(ingestion): Add secret masking framework (#15188 )

2025-11-12 22:22:37 -08:00

test_mapping.py

feat(meta-mappping): support meta mappings of lists (#14306 )

2025-08-01 12:26:45 -07:00

test_mariadb_source.py

…

test_masking_coverage.py

feat(ingestion): Add secret masking framework (#15188 )

2025-11-12 22:22:37 -08:00

test_masking_edge_cases.py

feat(ingestion): Add secret masking framework (#15188 )

2025-11-12 22:22:37 -08:00

test_masking_error_paths.py

feat(ingestion): Add secret masking framework (#15188 )

2025-11-12 22:22:37 -08:00

test_masking_error_recovery.py

feat(ingestion): Add secret masking framework (#15188 )

2025-11-12 22:22:37 -08:00

test_masking_filter.py

feat(ingestion): Add secret masking framework (#15188 )

2025-11-12 22:22:37 -08:00

test_metabase_source.py

chore: Remove Pydantic V1 deprecation warnings (#15057 )

2025-11-05 14:31:43 +00:00

test_mlflow_source.py

feat(ingest/mlflow): add dataset lineage (#12837 )

2025-03-21 08:38:43 +09:00

test_mongodb_source.py

fix(ingestion/mongodb): Fix handling of arrays containing complex structures (#15026 )

2025-10-17 18:49:05 +02:00

test_mssql.py

fix(mssql): replace permission-based RDS detection with server name analysis and fix SQLAlchemy 1.4+ compatibility (#14975 )

2025-10-27 10:11:49 +00:00

test_mysql_rds_iam.py

refactor(pydantic): remove Pydantic v1 legacy code and migrate fully to v2 (#15261 )

2025-11-12 09:57:06 +00:00

test_neo4j_source.py

feat(ingest/neo4j): migrate Neo4j source to DataHub Python SDK v2 (#14591 )

2025-09-15 08:42:54 +00:00

test_nifi_source.py

chore: Remove Pydantic V1 deprecation warnings (#15057 )

2025-11-05 14:31:43 +00:00

test_openapi.py

feat(openapi): rework to pull schemas from openapi v2 and v3 definitions (#14045 )

2025-11-14 17:07:26 +00:00

test_oracle_source.py

chore: Remove Pydantic V1 deprecation warnings (#15057 )

2025-11-05 14:31:43 +00:00

test_packages.py

feat(sdk): move version info to dedicated file (#12456 )

2025-01-24 11:35:39 -08:00

test_packaging.py

fix: fixes mypy complaints about pkgresources (#12790 )

2025-03-05 12:41:03 +01:00

test_postgres_rds_iam.py

refactor(pydantic): remove Pydantic v1 legacy code and migrate fully to v2 (#15261 )

2025-11-12 09:57:06 +00:00

test_postgres_source.py

chore: Remove Pydantic V1 deprecation warnings (#15057 )

2025-11-05 14:31:43 +00:00

test_powerbi_parser.py

refactor(ingest/powerbi): organize code within the module based on responsibilities (#11924 )

2024-11-27 09:32:24 -08:00

test_preset_source.py

chore: Remove Pydantic V1 deprecation warnings (#15057 )

2025-11-05 14:31:43 +00:00

test_protobuf_util.py

dev: enable ruff rule (#12749 )

2025-02-28 17:49:52 +05:30

test_pulsar_source.py

chore(python): drop pydantic v1 support (#14014 )

2025-09-23 07:40:29 +00:00

test_rds_iam_utils.py

feat(ingest/postgres,mysql): Add iam auth support for MySql and Postgresql source (#14899 )

2025-10-21 08:33:39 +02:00

test_redash_source.py

fix(ingest): change redash sql parse error to warnining (#14785 )

2025-09-17 08:06:15 -04:00

test_rest_sink.py

feat(ingestion): refactor api-tracing EmitMode (#13397 )

2025-05-05 10:54:31 -05:00

test_schema_util.py

fix(ingest/avro): expand record fields consistently in arrays, maps, and direct references (#13961 )

2025-07-10 11:00:59 +02:00

test_secret_registry.py

feat(ingestion): Add secret masking framework (#15188 )

2025-11-12 22:22:37 -08:00

test_source.py

fix(ingest): only add to samples where platform match (#14722 )

2025-09-11 13:26:39 +05:30

test_sql_common.py

chore: Remove Pydantic V1 deprecation warnings (#15057 )

2025-11-05 14:31:43 +00:00

test_sql_types.py

feat(ingest/neo4j): migrate Neo4j source to DataHub Python SDK v2 (#14591 )

2025-09-15 08:42:54 +00:00

test_sql_utils.py

fix(ingest/profiling): Filter tables early based on profile pattern filter (#10378 )

2024-04-26 17:35:03 +02:00

test_superset_source.py

chore: Remove Pydantic V1 deprecation warnings (#15057 )

2025-11-05 14:31:43 +00:00

test_teradata_integration.py

chore: Remove Pydantic V1 deprecation warnings (#15057 )

2025-11-05 14:31:43 +00:00

test_teradata_performance.py

chore: Remove Pydantic V1 deprecation warnings (#15057 )

2025-11-05 14:31:43 +00:00

test_teradata_source.py

chore: Remove Pydantic V1 deprecation warnings (#15057 )

2025-11-05 14:31:43 +00:00

test_transform_dataset.py

fix(ingest/transformer): Preserve manually set domains in PatternAddDatasetDomain with PATCH semantics (#15259 )

2025-11-11 16:42:20 +01:00

test_unity_catalog_config.py

chore: Remove Pydantic V1 deprecation warnings (#15057 )

2025-11-05 14:31:43 +00:00

test_unity_catalog_proxy.py

bug(unity-catalog): update parameter key in UnityCatalogApiProxy for MLFlow Model files (#15220 )

2025-11-06 02:23:39 +00:00

test_unity_catalog_source.py

refactor(pydantic): remove Pydantic v1 legacy code and migrate fully to v2 (#15261 )

2025-11-12 09:57:06 +00:00

test_unity_catalog_tag_entities.py

fix(ingest/unity-catalog): Speed up tag extraction by caching platform resources (#14376 )

2025-08-11 22:51:25 +02:00

test_usage_common.py

feat(ingest): respect user email pattern in usage aggregator (#14562 )

2025-09-03 23:34:42 +00:00

test_user_add.py

feat(cli): add user add command (#15011 )

2025-10-16 20:36:59 +05:30

test_vertexai_source.py

fix(ingest/vertex): Vertex null start date fix (#15258 )

2025-11-11 15:27:57 +01:00

test_vertica_source.py

chore: Remove Pydantic V1 deprecation warnings (#15057 )

2025-11-05 14:31:43 +00:00