datahub

api

fix(ingestion/kafka): OAuth callback execution (#11900 )

2024-11-22 13:08:23 +05:30

bigquery

chore(ingest): bump black (#11898 )

2024-11-20 13:33:54 -08:00

cli

fix(cli): don't use /api in gms url (#12083 )

2024-12-11 16:11:08 +05:30

config

chore(ingest): reorganize unit tests (#11636 )

2024-10-16 19:18:32 -07:00

data_lake

feat(ingest): Support for JSONL in s3 source with max_rows support (#9921 )

2024-02-28 15:05:30 +01:00

glue

chore(ingest): start using explicit exports (#11899 )

2024-11-20 13:33:30 -08:00

patch

fix(py-sdk): DataJobPatchBuilder handling timestamps, output edges (#12067 )

2024-12-09 19:40:31 -05:00

redshift

chore(ingest): bump black (#11898 )

2024-11-20 13:33:54 -08:00

reporting

…

s3

feat(ingest/s3): Partition support improvements (#11083 )

2024-08-22 17:55:43 +02:00

sagemaker

fix(ingest/sagemaker): Gracefully handle missing model group (#12000 )

2024-12-03 10:48:04 +01:00

schema

fix(ingest/json-schema): adding support descriptions for array (#9757 )

2024-03-01 13:03:47 -08:00

sdk

chore(ingest): reorganize unit tests (#11636 )

2024-10-16 19:18:32 -07:00

serde

chore(ingest): start using explicit exports (#11899 )

2024-11-20 13:33:30 -08:00

snowflake

feat(snowflake): adding oauth token bypass to snowflake (#12048 )

2024-12-05 17:50:56 -08:00

sql_parsing

feat(ingest/mssql): include stored procedure lineage (#11912 )

2024-11-22 20:32:24 +05:30

stateful_ingestion

chore(ingest): bump black (#11898 )

2024-11-20 13:33:54 -08:00

urns

feat(ingest): add urn validation test files (#12036 )

2024-12-05 08:32:31 -08:00

utilities

feat(ingest): allow max_workers=1 with ASYNC_BATCH rest sink (#12088 )

2024-12-10 18:32:52 -05:00

__init__.py

…

test_athena_source.py

feat(ingest/athena): handle partition fetching errors (#11966 )

2024-11-28 21:42:55 -05:00

test_capability_report.py

…

test_cassandra_source.py

chore(ingest): bump black (#11898 )

2024-11-20 13:33:54 -08:00

test_classification.py

feat(classifier): Add support for excluding list of exact column names (#9472 )

2024-01-16 19:12:23 -08:00

test_clickhouse_source.py

…

test_cockroach_source.py

feat(ingest/cockroachdb): add cockroachdb ingestion (#10226 )

2024-04-09 18:36:51 -07:00

test_compare_metadata.py

…

test_confluent_schema_registry.py

fix(ingestion/kafka): OAuth callback execution (#11900 )

2024-11-22 13:08:23 +05:30

test_csv_enricher_source.py

feat(ingest/csv-enricher): add support for ownership type urn (#9935 )

2024-02-27 17:47:04 +00:00

test_datahub_source.py

feat(ingest/datahub): Add way to filter soft deleted entities (#11738 )

2024-10-30 17:41:45 +01:00

test_dbt_source.py

fix(ingest/dbt): Prevent lineage cycles when parsing sql of dbt models (#11666 )

2024-10-18 03:13:18 -07:00

test_druid_source.py

…

test_elasticsearch_source.py

feat(ingest): fix validators (#10115 )

2024-03-27 15:20:55 -07:00

test_file_lineage_source.py

feat(ingest): fix validators (#10115 )

2024-03-27 15:20:55 -07:00

test_gc.py

fix(ingest/gc): Additional dataprocess cleanup fixes (#12049 )

2024-12-07 13:45:14 +01:00

test_gcs_source.py

…

test_ge_profiling_config.py

…

test_generic_aspect_transformer.py

chore(ingest): remove deprecated calls to Urn.create_from_string (#11983 )

2024-12-02 09:53:13 -08:00

test_hana_source.py

…

test_hive_source.py

…

test_iceberg.py

feat(ingest/iceberg): Iceberg performance improvement (multi-threading) (#11182 )

2024-11-18 19:41:45 +01:00

test_kafka_sink.py

…

test_kafka_source.py

feat(ingest/kafka): Flag for optional schemas ingestion (#12077 )

2024-12-11 16:02:31 +00:00

test_ldap_source.py

…

test_mapping.py

feat(ingest): support full urns without owner_type in meta mapping (#11298 )

2024-09-09 11:18:07 -07:00

test_mariadb_source.py

…

test_metabase_source.py

feat(metabase): add stateful ingestion (#10360 )

2024-05-02 12:04:18 -07:00

test_mlflow_source.py

fix(ingest/delta-lake): skip file count if require_files is false (#11611 )

2024-10-14 18:21:05 +05:30

test_neo4j_source.py

feat(ingest): connector for Neo4j (#11526 )

2024-12-02 14:53:28 +05:30

test_nifi_source.py

fix(ingestion/nifi): Improve nifi lineage extraction performance (#11490 )

2024-10-01 21:51:00 +02:00

test_openapi.py

…

test_oracle_source.py

fix(ingest/oracle): fix scheme for sqlalchemy < 2 (#11829 )

2024-11-14 12:46:27 +05:30

test_packages.py

fix(ingest): add custom StrEnum type (#11270 )

2024-09-04 08:09:36 -07:00

test_packaging.py

…

test_postgres_source.py

…

test_powerbi_parser.py

refactor(ingest/powerbi): organize code within the module based on responsibilities (#11924 )

2024-11-27 09:32:24 -08:00

test_preset_source.py

feat(ingest/superset): initial support for superset datasets (#11972 )

2024-12-06 13:48:00 -08:00

test_protobuf_util.py

…

test_pulsar_source.py

feat(ingest): fix validators (#10115 )

2024-03-27 15:20:55 -07:00

test_redash_source.py

fix(ingest): replace sqllineage/sqlparse with our SQL parser (#12020 )

2024-12-10 08:36:01 -08:00

test_rest_sink.py

fix(ingest): set lastObserved in sdk when unset (#11071 )

2024-08-02 15:48:10 -07:00

test_schema_util.py

…

test_source.py

…

test_sql_common.py

chore(ingest): always use urn creation helpers (#11911 )

2024-11-21 13:49:41 +05:30

test_sql_types.py

feat(ingest): standardize sql type mappings (#11982 )

2024-11-28 14:53:46 -05:00

test_sql_utils.py

fix(ingest/profiling): Filter tables early based on profile pattern filter (#10378 )

2024-04-26 17:35:03 +02:00

test_superset_source.py

…

test_tableau_source.py

fix(ingestion/tableau): restructure the tableau graphql datasource query (#11230 )

2024-09-09 10:45:06 -07:00

test_transform_dataset.py

chore(ingest): remove deprecated calls to Urn.create_from_string (#11983 )

2024-12-02 09:53:13 -08:00

test_unity_catalog_config.py

fix(ingest/databricks): handle and report config parse failure, updat… (#10261 )

2024-04-17 12:14:16 -07:00

test_usage_common.py

feat(ingest): set pipeline name in system metadata (#10190 )

2024-06-27 15:00:35 -07:00

test_vertica_source.py

…