datahub

api

fix(model): fixes DashboardContainsDashboard relationship in DashboardInfo aspect (#12433 )

2025-02-03 11:33:25 +01:00

bigquery

dev: remove black in favor of ruff for formatting (#12378 )

2025-01-18 15:06:20 +05:30

cli

dev: remove black in favor of ruff for formatting (#12378 )

2025-01-18 15:06:20 +05:30

config

feat(ingest): add strict_env_syntax mode to config loader (#12380 )

2025-01-17 14:26:00 -08:00

data_lake

feat(ingest/s3): ignore depth mismatched path (#12326 )

2025-02-05 11:19:44 -08:00

datahub/emitter

feat(ingestion/airflow): Add support for mutiple datahub emitter (#12398 )

2025-01-29 16:44:31 +01:00

dremio

fix(ingestion/dremio): Ignore filtered containers in schema allowdeny pattern (#11959 )

2024-12-13 14:55:31 +05:30

glue

fix(ingest/glue): Add additional checks and logging when specifying catalog_id (#12168 )

2024-12-24 14:56:35 -08:00

patch

fix(py-sdk): DataJobPatchBuilder handling timestamps, output edges (#12067 )

2024-12-09 19:40:31 -05:00

redshift

dev: remove black in favor of ruff for formatting (#12378 )

2025-01-18 15:06:20 +05:30

reporting

chore(tableau): set ingestion stage report and perftimers (#12234 )

2025-01-09 19:04:37 +01:00

s3

feat(ingest/s3): ignore depth mismatched path (#12326 )

2025-02-05 11:19:44 -08:00

sagemaker

fix(ingest/snowflake): handle dots in snowflake table names (#12105 )

2024-12-12 15:31:32 +05:30

schema

fix(ingest/json-schema): adding support descriptions for array (#9757 )

2024-03-01 13:03:47 -08:00

sdk

feat(sdk): add ContainerKey.parent_key method (#12423 )

2025-01-22 12:44:44 -08:00

serde

dev: remove black in favor of ruff for formatting (#12378 )

2025-01-18 15:06:20 +05:30

snowflake

fix(ingest/snowflake): always ingest view and external table ddl lineage (#12191 )

2024-12-24 18:14:51 +05:30

sql_parsing

fix(ingestion): groupby_unsorted (#12403 )

2025-01-21 09:44:19 +01:00

stateful_ingestion

dev: remove black in favor of ruff for formatting (#12378 )

2025-01-18 15:06:20 +05:30

structured_properties

feat(sdk): structured properties - add support for listing (#12283 )

2025-01-09 07:32:22 -08:00

urns

feat(sdk): support qualified urn names in simple urn constructors (#12426 )

2025-01-22 13:46:24 -08:00

utilities

fix(ingestion): groupby_unsorted (#12403 )

2025-01-21 09:44:19 +01:00

__init__.py

…

test_athena_source.py

feat(ingest/athena): handle partition fetching errors (#11966 )

2024-11-28 21:42:55 -05:00

test_aws_common.py

fix(ingest/aws_common): update tests execution on EC2 instance (#12252 )

2025-01-01 14:49:27 +05:30

test_capability_report.py

fix(ingest): fix serialization of report to handle nesting (#5455 )

2022-07-20 18:25:07 -07:00

test_cassandra_source.py

chore(ingest): bump black (#11898 )

2024-11-20 13:33:54 -08:00

test_classification.py

feat(classifier): Add support for excluding list of exact column names (#9472 )

2024-01-16 19:12:23 -08:00

test_clickhouse_source.py

fix(ingest/sqlalchemy): Fix URL parsing when sqlalchemy_uri provided (#9032 )

2023-10-18 17:34:45 +02:00

test_cockroach_source.py

feat(ingest/cockroachdb): add cockroachdb ingestion (#10226 )

2024-04-09 18:36:51 -07:00

test_compare_metadata.py

test(ingest): Aspect level golden file comparison (#8310 )

2023-07-11 10:39:47 -04:00

test_confluent_schema_registry.py

dev: remove black in favor of ruff for formatting (#12378 )

2025-01-18 15:06:20 +05:30

test_csv_enricher_source.py

feat(ingest/csv-enricher): add support for ownership type urn (#9935 )

2024-02-27 17:47:04 +00:00

test_datahub_source.py

feat(ingest/datahub): Add way to filter soft deleted entities (#11738 )

2024-10-30 17:41:45 +01:00

test_dbt_source.py

dev: remove black in favor of ruff for formatting (#12378 )

2025-01-18 15:06:20 +05:30

test_druid_source.py

fix(ingest): bigquery - sharded table support improvements (#6789 )

2022-12-19 18:57:37 +01:00

test_elasticsearch_source.py

feat(ingest): fix validators (#10115 )

2024-03-27 15:20:55 -07:00

test_file_lineage_source.py

feat(ingest): fix validators (#10115 )

2024-03-27 15:20:55 -07:00

test_gc.py

fix(ingest/gc): logging and stopping fix (#12266 )

2025-01-03 22:15:52 +05:30

test_gcs_source.py

fix(ingestion): fix stateful ingestion for GCS source (#11879 )

2025-01-20 19:37:12 +05:30

test_ge_profiling_config.py

fix(ingest/sql-common): Fix profile_table_level_only (#8331 )

2023-07-07 19:05:50 -04:00

test_generic_aspect_transformer.py

chore(ingest): remove deprecated calls to Urn.create_from_string (#11983 )

2024-12-02 09:53:13 -08:00

test_hana_source.py

…

test_hive_source.py

fix(ingest): bigquery - sharded table support improvements (#6789 )

2022-12-19 18:57:37 +01:00

test_iceberg.py

dev: remove black in favor of ruff for formatting (#12378 )

2025-01-18 15:06:20 +05:30

test_kafka_sink.py

chore(ingest): remove inferred args to MCPW, part 2 (#6905 )

2023-01-04 23:29:56 -05:00

test_kafka_source.py

feat(ingest/kafka): Flag for optional schemas ingestion (#12077 )

2024-12-11 16:02:31 +00:00

test_ldap_source.py

fix(ldap): properly handle escaped characters in LDAP DNs (#7928 )

2023-05-03 13:57:52 -07:00

test_mapping.py

feat(ingest): support full urns without owner_type in meta mapping (#11298 )

2024-09-09 11:18:07 -07:00

test_mariadb_source.py

…

test_metabase_source.py

feat(metabase): add stateful ingestion (#10360 )

2024-05-02 12:04:18 -07:00

test_mlflow_source.py

feat(ingest/mlflow): Support configurable base_external_url (#12167 )

2024-12-18 14:36:10 -08:00

test_neo4j_source.py

feat(ingest): connector for Neo4j (#11526 )

2024-12-02 14:53:28 +05:30

test_nifi_source.py

fix(ingestion/nifi): Improve nifi lineage extraction performance (#11490 )

2024-10-01 21:51:00 +02:00

test_openapi.py

feat(ingest): add ability to read other method types than GET for OAS ingest recipes (#8303 )

2023-08-02 09:54:09 +05:30

test_oracle_source.py

fix(ingest/oracle): fix scheme for sqlalchemy < 2 (#11829 )

2024-11-14 12:46:27 +05:30

test_packages.py

feat(sdk): move version info to dedicated file (#12456 )

2025-01-24 11:35:39 -08:00

test_packaging.py

feat(sdk): move version info to dedicated file (#12456 )

2025-01-24 11:35:39 -08:00

test_postgres_source.py

dev: remove black in favor of ruff for formatting (#12378 )

2025-01-18 15:06:20 +05:30

test_powerbi_parser.py

refactor(ingest/powerbi): organize code within the module based on responsibilities (#11924 )

2024-11-27 09:32:24 -08:00

test_preset_source.py

feat(ingest/superset): initial support for superset datasets (#11972 )

2024-12-06 13:48:00 -08:00

test_protobuf_util.py

fix(ingest): bigquery - sharded table support improvements (#6789 )

2022-12-19 18:57:37 +01:00

test_pulsar_source.py

feat(ingest): fix validators (#10115 )

2024-03-27 15:20:55 -07:00

test_redash_source.py

fix(ingest): replace sqllineage/sqlparse with our SQL parser (#12020 )

2024-12-10 08:36:01 -08:00

test_rest_sink.py

dev: remove black in favor of ruff for formatting (#12378 )

2025-01-18 15:06:20 +05:30

test_schema_util.py

feat(ingest/kafka): support metadata mapping from kafka avro schemas (#8825 )

2023-09-22 17:11:42 -07:00

test_source.py

feat(ingest): Create Browse Paths V2 under flag (#8120 )

2023-06-02 12:50:38 -07:00

test_sql_common.py

chore(ingest): always use urn creation helpers (#11911 )

2024-11-21 13:49:41 +05:30

test_sql_types.py

feat(ingest): standardize sql type mappings (#11982 )

2024-11-28 14:53:46 -05:00

test_sql_utils.py

fix(ingest/profiling): Filter tables early based on profile pattern filter (#10378 )

2024-04-26 17:35:03 +02:00

test_superset_source.py

fix(ingest/superset): support superset v2 (#7588 )

2023-03-20 19:49:32 -07:00

test_tableau_source.py

feat(tableau): fine-grained page size (#12354 )

2025-01-16 16:43:46 +01:00

test_transform_dataset.py

chore(ingest): remove deprecated calls to Urn.create_from_string (#11983 )

2024-12-02 09:53:13 -08:00

test_unity_catalog_config.py

fix(ingest/databricks): handle and report config parse failure, updat… (#10261 )

2024-04-17 12:14:16 -07:00

test_usage_common.py

fix(ingest): consistent fingerprint for sql parsing aggregator (#12239 )

2025-01-03 10:49:42 -08:00

test_vertica_source.py

fix(ingest): bigquery - sharded table support improvements (#6789 )

2022-12-19 18:57:37 +01:00