datahub

api

feat(ingestion): Refactoring timestamping logic for WorkUnits + custom logic for Iceberg (#13030 )

2025-04-04 22:30:27 +02:00

bigquery

dev: enable ruff rule (#12749 )

2025-02-28 17:49:52 +05:30

cli

feat(dataset_cli): add dry-run support (#12814 )

2025-03-29 18:08:52 +05:30

config

feat(ingest): add strict_env_syntax mode to config loader (#12380 )

2025-01-17 14:26:00 -08:00

data_lake

feat(ingest/s3): add table filtering (#12661 )

2025-03-20 07:57:43 +01:00

datahub/emitter

fix(ingest): warn when API tracing is unexpectedly inactive (#13007 )

2025-03-27 22:21:33 -07:00

dbt

feat(ingestion/dbt): Add include_database_name parameter for dbt core (#12411 )

2025-02-11 10:42:14 +01:00

dremio

fix(ingest/dremio): simplify and fix build source map (#12908 )

2025-03-21 11:31:16 +05:30

glue

feat(ingestion): Refactoring timestamping logic for WorkUnits + custom logic for Iceberg (#13030 )

2025-04-04 22:30:27 +02:00

hex

fix(hex): filter out queries if non scheduled runs (#13126 )

2025-04-08 20:55:28 +02:00

patch

fix(py-sdk): DataJobPatchBuilder handling timestamps, output edges (#12067 )

2024-12-09 19:40:31 -05:00

powerbi

feat(ingest/powerbi): Support ODBC Data Source (#13090 )

2025-04-10 08:57:37 -05:00

redshift

feat(ingest/redshift): lineage for external schema created from redshift (#12826 )

2025-03-11 17:43:34 +05:30

reporting

chore(tableau): set ingestion stage report and perftimers (#12234 )

2025-01-09 19:04:37 +01:00

s3

refactor(ingest/s3): enhance readability (#12686 )

2025-02-28 14:19:46 +01:00

sagemaker

feat(ingestion): Refactoring timestamping logic for WorkUnits + custom logic for Iceberg (#13030 )

2025-04-04 22:30:27 +02:00

schema

dev: enable ruff rule (#12749 )

2025-02-28 17:49:52 +05:30

sdk

feat(sdk): auto-fix bad entity type casing (#13218 )

2025-04-20 21:40:00 -07:00

sdk_v2

feat(sdk): add sdk lineage client (#13244 )

2025-04-17 17:44:07 +09:00

serde

feat(ingest): improve error messages for unknown metadata objects (#12745 )

2025-02-28 12:36:58 -08:00

snowflake

fix(ingest/snowflake): Fixing table rename query handling (#12852 )

2025-03-13 23:26:23 +01:00

sql_parsing

fix(snowflake): fixes deduplication and fingerprint requirements for Hex (#13121 )

2025-04-09 10:17:43 +02:00

stateful_ingestion

dev: remove black in favor of ruff for formatting (#12378 )

2025-01-18 15:06:20 +05:30

stored_procedure

fix(ingest): split merge statements correctly (#12989 )

2025-03-27 14:24:50 +05:30

structured_properties

feat(sdk): structured properties - add support for listing (#12283 )

2025-01-09 07:32:22 -08:00

tableau

feat(ingest/tableau): Allow specifying asset types for ingest_hidden_assets (#13190 )

2025-04-11 20:07:37 -07:00

urns

dev: enable ruff rule (#12749 )

2025-02-28 17:49:52 +05:30

utilities

feat(cli): add extra pip and debug flag (#12621 )

2025-02-17 16:03:07 +05:30

__init__.py

…

test_athena_source.py

dev: enable ruff rule (#12749 )

2025-02-28 17:49:52 +05:30

test_aws_common.py

fix(ingest/aws_common): update tests execution on EC2 instance (#12252 )

2025-01-01 14:49:27 +05:30

test_business_glossary.py

feat(ingestion/business-glossary): Automatically generate predictable glossary term and node URNs when incompatible URL characters are specified in term and node names. (#12673 )

2025-03-06 14:30:10 +00:00

test_capability_report.py

…

test_cassandra_source.py

chore(ingest): bump black (#11898 )

2024-11-20 13:33:54 -08:00

test_classification.py

…

test_clickhouse_source.py

…

test_cockroach_source.py

feat(ingest/cockroachdb): add cockroachdb ingestion (#10226 )

2024-04-09 18:36:51 -07:00

test_compare_metadata.py

…

test_confluent_schema_registry.py

dev: remove black in favor of ruff for formatting (#12378 )

2025-01-18 15:06:20 +05:30

test_csv_enricher_source.py

…

test_datahub_source.py

feat(ingest/datahub): Add way to filter soft deleted entities (#11738 )

2024-10-30 17:41:45 +01:00

test_druid_source.py

Fix platform instance support on Druid ingestion (#12716 )

2025-02-26 08:36:06 +01:00

test_elasticsearch_source.py

feat(ingest): fix validators (#10115 )

2024-03-27 15:20:55 -07:00

test_file_lineage_source.py

feat(ingest): fix validators (#10115 )

2024-03-27 15:20:55 -07:00

test_gc.py

fix(ingest/gc): Fix for slow soft-deleted entity deletion (#12931 )

2025-03-27 09:43:48 +01:00

test_gcs_source.py

fix(ingestion): fix stateful ingestion for GCS source (#11879 )

2025-01-20 19:37:12 +05:30

test_ge_profiling_config.py

…

test_generic_aspect_transformer.py

chore(ingest): remove calls to deprecated methods (#13009 )

2025-03-28 13:42:54 -07:00

test_hana_source.py

…

test_hive_source.py

…

test_iceberg.py

feat(ingestion/iceberg): Add capability to extract namespace properties to the iceberg ingestor (#13238 )

2025-04-17 16:29:43 +02:00

test_kafka_sink.py

…

test_kafka_source.py

dev: enable ruff rule (#12749 )

2025-02-28 17:49:52 +05:30

test_ldap_source.py

…

test_mapping.py

feat(ingest): support full urns without owner_type in meta mapping (#11298 )

2024-09-09 11:18:07 -07:00

test_mariadb_source.py

…

test_metabase_source.py

feat(ingest/metabase): API key support in Metabase source (#12711 )

2025-02-28 11:01:07 +05:30

test_mlflow_source.py

feat(ingest/mlflow): add dataset lineage (#12837 )

2025-03-21 08:38:43 +09:00

test_neo4j_source.py

feat(ingest): connector for Neo4j (#11526 )

2024-12-02 14:53:28 +05:30

test_nifi_source.py

fix(ingestion/nifi): Improve nifi lineage extraction performance (#11490 )

2024-10-01 21:51:00 +02:00

test_openapi.py

[BREAKING CHANGE] fix(openapi): fixing openapi nesting (#12580 )

2025-02-18 06:05:54 -08:00

test_oracle_source.py

fix(ingest/oracle): fix scheme for sqlalchemy < 2 (#11829 )

2024-11-14 12:46:27 +05:30

test_packages.py

feat(sdk): move version info to dedicated file (#12456 )

2025-01-24 11:35:39 -08:00

test_packaging.py

fix: fixes mypy complaints about pkgresources (#12790 )

2025-03-05 12:41:03 +01:00

test_postgres_source.py

dev: remove black in favor of ruff for formatting (#12378 )

2025-01-18 15:06:20 +05:30

test_powerbi_parser.py

refactor(ingest/powerbi): organize code within the module based on responsibilities (#11924 )

2024-11-27 09:32:24 -08:00

test_preset_source.py

feat(ingest): allowdenypattern for dashboard, chart, dataset in superset (#12782 )

2025-03-04 17:59:42 -05:00

test_protobuf_util.py

dev: enable ruff rule (#12749 )

2025-02-28 17:49:52 +05:30

test_pulsar_source.py

feat(ingest): fix validators (#10115 )

2024-03-27 15:20:55 -07:00

test_redash_source.py

fix(ingest): replace sqllineage/sqlparse with our SQL parser (#12020 )

2024-12-10 08:36:01 -08:00

test_rest_sink.py

fix(ingest): make emitter endpoint fully env-controlled (#13019 )

2025-03-28 12:21:54 -07:00

test_schema_util.py

fix(ingestion): schema-metadata - fix jsonProps not being ingested for optional fields (#12927 )

2025-03-22 08:41:11 -07:00

test_source.py

…

test_sql_common.py

dev: enable ruff rule (#12749 )

2025-02-28 17:49:52 +05:30

test_sql_types.py

feat(ingest): standardize sql type mappings (#11982 )

2024-11-28 14:53:46 -05:00

test_sql_utils.py

fix(ingest/profiling): Filter tables early based on profile pattern filter (#10378 )

2024-04-26 17:35:03 +02:00

test_superset_source.py

feat(ingestion/superset): superset column level lineage (#12786 )

2025-03-14 08:02:54 -07:00

test_transform_dataset.py

chore(ingest): remove calls to deprecated methods (#13009 )

2025-03-28 13:42:54 -07:00

test_unity_catalog_config.py

fix(ingest/databricks): handle and report config parse failure, updat… (#10261 )

2024-04-17 12:14:16 -07:00

test_usage_common.py

chore(ingest): remove calls to deprecated methods (#13009 )

2025-03-28 13:42:54 -07:00

test_vertexai_source.py

VertexAI Connector (v3 - pipeline and pipeline task) (#12960 )

2025-04-10 22:54:17 -07:00

test_vertica_source.py

…