datahub

api

tests(ingestion): moving some tests so they are available for sdk users (#13540 )

2025-05-19 08:39:53 +02:00

bigquery

fix(ingest): fix deps for fivetran (#13385 )

2025-05-02 12:31:07 -07:00

cli

fix(cli): strictly validate structured property values (#13576 )

2025-05-21 08:36:50 -07:00

config

chore(ingestion): removes ignore for SIM117 ruff rule (#13295 )

2025-04-23 15:55:46 +02:00

data_lake

feat(ingestion/s3): Add externalUrls for datasets in s3 and gcs (#12763 )

2025-05-17 17:03:40 +01:00

datahub/emitter

Revert "feat(tracing): python logging & update system metadata on no-op"

2025-05-26 12:15:18 -05:00

dbt

feat(ingest/dbt): make catalog.json optional (#13352 )

2025-04-29 10:39:53 -07:00

dremio

fix(ingest/dremio): simplify and fix build source map (#12908 )

2025-03-21 11:31:16 +05:30

excel

feat(ingest/excel): Add Excel Source

2025-05-06 21:07:11 -05:00

glue

tests(ingestion): moving some tests so they are available for sdk users (#13540 )

2025-05-19 08:39:53 +02:00

hex

feat(hex): consider additional context when parsing hex query metadata (#13596 )

2025-05-23 08:01:04 +02:00

patch

tests(ingestion): moving some tests so they are available for sdk users (#13540 )

2025-05-19 08:39:53 +02:00

powerbi

feat(ingest/powerbi): Support ODBC Data Source (#13090 )

2025-04-10 08:57:37 -05:00

redshift

feat(ingest/sql): column logic + join extraction (#13426 )

2025-05-12 17:19:44 -07:00

reporting

chore(tableau): set ingestion stage report and perftimers (#12234 )

2025-01-09 19:04:37 +01:00

s3

feat(ingestion/s3): Add externalUrls for datasets in s3 and gcs (#12763 )

2025-05-17 17:03:40 +01:00

sagemaker

tests(ingestion): moving some tests so they are available for sdk users (#13540 )

2025-05-19 08:39:53 +02:00

schema

dev: enable ruff rule (#12749 )

2025-02-28 17:49:52 +05:30

sdk

feat(ingestion): refactor api-tracing EmitMode (#13397 )

2025-05-05 10:54:31 -05:00

sdk_v2

tests(ingestion): moving some tests so they are available for sdk users (#13540 )

2025-05-19 08:39:53 +02:00

serde

tests(ingestion): moving some tests so they are available for sdk users (#13540 )

2025-05-19 08:39:53 +02:00

snowflake

feat(ingest/snowflake): show returned query row counts (#13246 )

2025-04-21 14:41:40 -07:00

sql_parsing

tests(ingestion): moving some tests so they are available for sdk users (#13540 )

2025-05-19 08:39:53 +02:00

stateful_ingestion

tests(ingestion): moving some tests so they are available for sdk users (#13540 )

2025-05-19 08:39:53 +02:00

stored_procedure

tests(ingestion): moving some tests so they are available for sdk users (#13540 )

2025-05-19 08:39:53 +02:00

structured_properties

fix(cli): strictly validate structured property values (#13576 )

2025-05-21 08:36:50 -07:00

tableau

feat(ingest/tableau): Allow specifying asset types for ingest_hidden_assets (#13190 )

2025-04-11 20:07:37 -07:00

urns

dev: enable ruff rule (#12749 )

2025-02-28 17:49:52 +05:30

utilities

feat(ingest): improve join extraction (#13502 )

2025-05-14 09:50:17 -07:00

__init__.py

feat(ingest): add support for Glue ETL jobs (#2687 )

2021-06-22 11:33:22 -07:00

test_athena_source.py

dev: enable ruff rule (#12749 )

2025-02-28 17:49:52 +05:30

test_aws_common.py

fix(ingest/aws_common): update tests execution on EC2 instance (#12252 )

2025-01-01 14:49:27 +05:30

test_business_glossary.py

feat(ingestion/business-glossary): Automatically generate predictable glossary term and node URNs when incompatible URL characters are specified in term and node names. (#12673 )

2025-03-06 14:30:10 +00:00

test_capability_report.py

fix(ingest): fix serialization of report to handle nesting (#5455 )

2022-07-20 18:25:07 -07:00

test_cassandra_source.py

feat(cassandra): Support ssl auth with cassandra (#13465 )

2025-05-12 13:15:49 -04:00

test_classification.py

feat(classifier): Add support for excluding list of exact column names (#9472 )

2024-01-16 19:12:23 -08:00

test_clickhouse_source.py

fix(ingest/sqlalchemy): Fix URL parsing when sqlalchemy_uri provided (#9032 )

2023-10-18 17:34:45 +02:00

test_cockroach_source.py

feat(ingest/cockroachdb): add cockroachdb ingestion (#10226 )

2024-04-09 18:36:51 -07:00

test_compare_metadata.py

tests(ingestion): moving some tests so they are available for sdk users (#13540 )

2025-05-19 08:39:53 +02:00

test_confluent_schema_registry.py

dev: remove black in favor of ruff for formatting (#12378 )

2025-01-18 15:06:20 +05:30

test_csv_enricher_source.py

feat(ingest/csv-enricher): add support for ownership type urn (#9935 )

2024-02-27 17:47:04 +00:00

test_datahub_source.py

fix(ingest/datahub): Create Structured property templates in advance and batch processing (#13355 )

2025-05-26 14:05:17 +02:00

test_druid_source.py

Fix platform instance support on Druid ingestion (#12716 )

2025-02-26 08:36:06 +01:00

test_elasticsearch_source.py

feat(ingest): fix validators (#10115 )

2024-03-27 15:20:55 -07:00

test_file_lineage_source.py

feat(ingest): fix validators (#10115 )

2024-03-27 15:20:55 -07:00

test_gc.py

chore(ingestion): removes ignore for SIM117 ruff rule (#13295 )

2025-04-23 15:55:46 +02:00

test_gcs_source.py

feat(ingestion/s3): Add externalUrls for datasets in s3 and gcs (#12763 )

2025-05-17 17:03:40 +01:00

test_ge_profiling_config.py

fix(ingest/sql-common): Fix profile_table_level_only (#8331 )

2023-07-07 19:05:50 -04:00

test_generic_aspect_transformer.py

chore(ingest): remove calls to deprecated methods (#13009 )

2025-03-28 13:42:54 -07:00

test_hana_source.py

fix(build): fix for hana build failure for aarch64. (#5019 )

2022-05-26 15:29:21 -07:00

test_hive_source.py

fix(ingest): bigquery - sharded table support improvements (#6789 )

2022-12-19 18:57:37 +01:00

test_iceberg.py

feat(ingestion/iceberg): Add capability to extract namespace properties to the iceberg ingestor (#13238 )

2025-04-17 16:29:43 +02:00

test_kafka_sink.py

chore(ingest): remove inferred args to MCPW, part 2 (#6905 )

2023-01-04 23:29:56 -05:00

test_kafka_source.py

fix(ingestion): use default generate_browse_path_v2 even if no pipeline_config (#13117 )

2025-04-23 13:25:58 +02:00

test_ldap_source.py

fix(ldap): properly handle escaped characters in LDAP DNs (#7928 )

2023-05-03 13:57:52 -07:00

test_mapping.py

fix(ingest/dbt): Fix urn validation in ownership type check (#13563 )

2025-05-21 13:02:26 +02:00

test_mariadb_source.py

feat(ingest): add mariadb as possible source (#3245 )

2021-10-12 23:27:47 -07:00

test_metabase_source.py

feat(ingest/metabase): API key support in Metabase source (#12711 )

2025-02-28 11:01:07 +05:30

test_mlflow_source.py

feat(ingest/mlflow): add dataset lineage (#12837 )

2025-03-21 08:38:43 +09:00

test_mssql.py

fix(mssql): improve stored proc lineage + add temporary_tables_pattern config (#13415 )

2025-05-13 10:36:52 +02:00

test_neo4j_source.py

feat(ingestion/neo4j): Add stateful_ingestion and platform_instance capabilities to connector (#12631 )

2025-04-26 11:52:20 +01:00

test_nifi_source.py

fix(ingestion/nifi): Improve nifi lineage extraction performance (#11490 )

2024-10-01 21:51:00 +02:00

test_openapi.py

[BREAKING CHANGE] fix(openapi): fixing openapi nesting (#12580 )

2025-02-18 06:05:54 -08:00

test_oracle_source.py

fix(ingest/oracle): fix scheme for sqlalchemy < 2 (#11829 )

2024-11-14 12:46:27 +05:30

test_packages.py

feat(sdk): move version info to dedicated file (#12456 )

2025-01-24 11:35:39 -08:00

test_packaging.py

fix: fixes mypy complaints about pkgresources (#12790 )

2025-03-05 12:41:03 +01:00

test_postgres_source.py

dev: remove black in favor of ruff for formatting (#12378 )

2025-01-18 15:06:20 +05:30

test_powerbi_parser.py

refactor(ingest/powerbi): organize code within the module based on responsibilities (#11924 )

2024-11-27 09:32:24 -08:00

test_preset_source.py

feat(ingest): filter by database in superset and preset (#13409 )

2025-05-09 09:51:59 -04:00

test_protobuf_util.py

dev: enable ruff rule (#12749 )

2025-02-28 17:49:52 +05:30

test_pulsar_source.py

fix(ingestion): use default generate_browse_path_v2 even if no pipeline_config (#13117 )

2025-04-23 13:25:58 +02:00

test_redash_source.py

fix(ingest): replace sqllineage/sqlparse with our SQL parser (#12020 )

2024-12-10 08:36:01 -08:00

test_rest_sink.py

feat(ingestion): refactor api-tracing EmitMode (#13397 )

2025-05-05 10:54:31 -05:00

test_schema_util.py

fix(ingestion): schema-metadata - fix jsonProps not being ingested for optional fields (#12927 )

2025-03-22 08:41:11 -07:00

test_source.py

feat(ingest): Create Browse Paths V2 under flag (#8120 )

2023-06-02 12:50:38 -07:00

test_sql_common.py

dev: enable ruff rule (#12749 )

2025-02-28 17:49:52 +05:30

test_sql_types.py

fix(ingest/dbt): Fix urn validation in ownership type check (#13563 )

2025-05-21 13:02:26 +02:00

test_sql_utils.py

fix(ingest/profiling): Filter tables early based on profile pattern filter (#10378 )

2024-04-26 17:35:03 +02:00

test_superset_source.py

feat(ingest): filter by database in superset and preset (#13409 )

2025-05-09 09:51:59 -04:00

test_transform_dataset.py

tests(ingestion): moving some tests so they are available for sdk users (#13540 )

2025-05-19 08:39:53 +02:00

test_unity_catalog_config.py

fix(ingest/databricks): handle and report config parse failure, updat… (#10261 )

2024-04-17 12:14:16 -07:00

test_usage_common.py

chore(ingest): remove calls to deprecated methods (#13009 )

2025-03-28 13:42:54 -07:00

test_vertexai_source.py

VertexAI Connector (v3 - pipeline and pipeline task) (#12960 )

2025-04-10 22:54:17 -07:00

test_vertica_source.py

fix(ingest): bigquery - sharded table support improvements (#6789 )

2022-12-19 18:57:37 +01:00