datahub

api

feat(ingest): support incremental column-level lineage (#10090 )

2024-03-21 09:18:12 +01:00

cli

feat(mysql): upgrade to version 8.2 for quickstart (#9241 )

2023-11-22 13:54:12 -06:00

config

feat(ingest/snowflake): generate query nodes for snowflake (#9966 )

2024-03-06 15:11:37 -08:00

data_lake

feat(ingest): Support for JSONL in s3 source with max_rows support (#9921 )

2024-02-28 15:05:30 +01:00

glue

…

graph

…

patch

feat(patch): refactor cll patch (#9922 )

2024-02-27 12:00:44 -06:00

reporting

…

s3

fix(ingest/s3): wrong sorting in case of multi-partition key (#8536 )

2023-08-02 09:54:33 +05:30

sagemaker

fix(ingest): Generate browse paths v2 for more sources; properly pass platform_instance (#8501 )

2023-07-25 11:35:34 +05:30

schema

fix(ingest/json-schema): adding support descriptions for array (#9757 )

2024-03-01 13:03:47 -08:00

serde

feat(ui/last-updated): Calculate last updated time as max(properties time, operation time) (#9242 )

2023-12-06 15:21:56 -05:00

sql_parsing

feat(ingest): emit platform for query entities (#10103 )

2024-03-26 11:22:53 -07:00

stateful_ingestion

feat(ingest): enable stateful_ingestion by default for DataHub rest sink (#9934 )

2024-03-05 11:18:03 -08:00

urns

feat(sdk): autogenerate urn types (#9257 )

2023-11-30 18:11:36 -05:00

utilities

fix(metadata-ingestion)glue connector failure when Optional field Type of PartitionKey is absent for a Table (#10052 )

2024-03-20 11:02:28 +01:00

__init__.py

…

redshift_query_mocker.py

fix(ingest/redshift): tweak lineage v2 queries (#10045 )

2024-03-15 12:16:18 -07:00

test_apis.py

…

test_athena_source.py

fix(ingest/athena): detect decimal type correctly (#9270 )

2023-11-20 16:57:48 +01:00

test_bigquery_lineage.py

feat(ingest): sql parsing aggregator (#9786 )

2024-02-09 16:27:45 -05:00

test_bigquery_profiler.py

fix(ingest/bigquery): fix partition and median queries for profiling (#8778 )

2023-09-06 12:48:11 -07:00

test_bigquery_source.py

fix(ingestion/bigquery): Table-view-snapshot Lineage Bug fix (#9579 )

2024-01-25 18:48:41 +05:30

test_bigquery_sql_lineage.py

feat(ingest): sql parsing aggregator (#9786 )

2024-02-09 16:27:45 -05:00

test_bigquery_usage.py

feat(ingest): sql parsing aggregator (#9786 )

2024-02-09 16:27:45 -05:00

test_bigqueryv2_usage_source.py

fix(ingest/bigquery): escape special characters for table descriptions (#9932 )

2024-03-05 21:00:09 +05:30

test_bq_get_partition_range.py

…

test_capability_report.py

…

test_check_upgrade.py

…

test_check.py

…

test_classification.py

feat(classifier): Add support for excluding list of exact column names (#9472 )

2024-01-16 19:12:23 -08:00

test_cli_logging.py

fix(ingest): tweak ingestion exit codes (#8418 )

2023-07-14 15:47:16 -07:00

test_cli_utils.py

feat(cli): option to init via username password, add lint for smoke-test (#9675 )

2024-01-31 14:42:40 +05:30

test_clickhouse_source.py

fix(ingest/sqlalchemy): Fix URL parsing when sqlalchemy_uri provided (#9032 )

2023-10-18 17:34:45 +02:00

test_codegen.py

…

test_compare_metadata.py

test(ingest): Aspect level golden file comparison (#8310 )

2023-07-11 10:39:47 -04:00

test_confluent_schema_registry.py

fix(ingest/kafka): use SchemaReference properties instead of dict access (#8615 )

2023-08-16 10:33:09 +05:30

test_csv_enricher_source.py

feat(ingest/csv-enricher): add support for ownership type urn (#9935 )

2024-02-27 17:47:04 +00:00

test_datahub_source.py

fix(ingest/datahub-source): Order by version in memory (#9185 )

2023-11-06 15:58:57 -05:00

test_dbt_source.py

feat(ingest/dbt): dbt model performance (#9992 )

2024-03-26 17:18:54 -07:00

test_druid_source.py

…

test_elasticsearch_source.py

feat(ingest): fix validators (#10115 )

2024-03-27 15:20:55 -07:00

test_file_lineage_source.py

feat(ingest): fix validators (#10115 )

2024-03-27 15:20:55 -07:00

test_gcs_source.py

…

test_ge_profiling_config.py

…

test_generic_aspect_transformer.py

test(ingest): Aspect level golden file comparison (#8310 )

2023-07-11 10:39:47 -04:00

test_glue_source_stubs.py

…

test_glue_source.py

fix(ingest/build): Fix sagemaker mypy and flake8 issues (#8530 )

2023-07-31 16:13:07 +02:00

test_great_expectations_action.py

…

test_hana_source.py

…

test_hive_source.py

…

test_iceberg.py

chore(cli): drop support for python 3.7 (#9731 )

2024-01-29 10:50:47 -08:00

test_kafka_emitter.py

…

test_kafka_sink.py

…

test_kafka_source.py

feat(ingest/kafka): support metadata mapping from kafka avro schemas (#8825 )

2023-09-22 17:11:42 -07:00

test_key_value_pattern.py

…

test_ldap_source.py

…

test_ldap_state.py

…

test_mapping.py

feat(ingestion/dbt): multiple node owner separated by comma (#9740 )

2024-01-31 16:38:26 +01:00

test_mariadb_source.py

…

test_mce_builder.py

fix(ingest): make user_urn and group_urn generation consider user and… (#9026 )

2023-12-14 21:33:36 +05:30

test_mcp_builder.py

feat(ingest): add entity_supports_aspect helper (#9120 )

2023-10-30 14:22:05 -07:00

test_mcp_wrapper.py

…

test_metabase_source.py

feat(ingest/metabase): Allow to configure a different url for links (#9727 )

2024-02-05 17:36:50 +05:30

test_mlflow_source.py

chore(cli): drop support for python 3.7 (#9731 )

2024-01-29 10:50:47 -08:00

test_nifi_source.py

fix(ingest/nifi): make s3 dataset urn consistent with s3 source (#9599 )

2024-01-12 11:07:53 +05:30

test_openapi.py

feat(ingest): add ability to read other method types than GET for OAS ingest recipes (#8303 )

2023-08-02 09:54:09 +05:30

test_oracle_source.py

…

test_ordered_set.py

feat(ingest): sql parsing aggregator (#9786 )

2024-02-09 16:27:45 -05:00

test_packages.py

feat(ingest): check for private import path usages (#10059 )

2024-03-18 14:59:18 -07:00

test_packaging.py

…

test_parsing_util.py

…

test_pipeline.py

test(ingest): use pytest-random-order for unit tests (#9753 )

2024-02-09 18:20:05 -05:00

test_plugin_system.py

…

test_postgres_source.py

fix(ingest): drop deprecated database_alias from sql sources (#9299 )

2023-11-28 15:49:49 -05:00

test_powerbi_parser.py

fix(ingest/powerbi): Allow old parser to parse [db].[schema].[table] table references (#9360 )

2023-12-04 13:21:42 -05:00

test_protobuf_util.py

…

test_pulsar_source.py

feat(ingest): fix validators (#10115 )

2024-03-27 15:20:55 -07:00

test_redash_source.py

…

test_redshift_config.py

feat(ingestion/redshift): support auto_incremental_lineage (#9010 )

2023-10-25 15:26:06 +05:30

test_redshift_lineage.py

feat(ingest): sql parsing aggregator (#9786 )

2024-02-09 16:27:45 -05:00

test_redshift_source.py

fix(ingest/redshift): patch instead of replace redshift custom properties (#9293 )

2024-03-11 11:16:44 -07:00

test_report.py

…

test_rest_emitter.py

feat(ingest): clean up DataHubRestEmitter return type (#9286 )

2023-11-30 21:00:43 -05:00

test_rest_sink.py

feat(search): search access controls (#9892 )

2024-02-28 16:57:26 -06:00

test_sagemaker_source_stubs.py

…

test_schema_util.py

feat(ingest/kafka): support metadata mapping from kafka avro schemas (#8825 )

2023-09-22 17:11:42 -07:00

test_snowflake_shares.py

feat(ingest/snowflake): allow shares config without platform instance (#8803 )

2023-09-25 14:04:05 +05:30

test_snowflake_source.py

fix(ingest/snowflake) - Fixing snowflake url with default region (#9443 )

2023-12-18 13:54:31 -05:00

test_source.py

…

test_sql_common.py

feat(ingestion): Add test_connection methods for important sources (#9334 )

2023-12-14 12:31:51 -05:00

test_sql_utils.py

…

test_superset_source.py

…

test_tableau_source.py

feat(tableau): ability to force extraction of table/column level linage from SQL queries (#9838 )

2024-03-21 09:27:22 +01:00

test_topological_sort.py

feat(ingest/dbt): dbt column-level lineage (#8991 )

2023-11-13 19:00:30 -05:00

test_transform_dataset.py

fix(ingest): added new transformer to cleanup suffix/prefix in owner URN (#10067 )

2024-03-22 15:23:03 +05:30

test_unity_catalog_config.py

feat(ingest/databricks): ingest hive metastore by default, more docs (#9601 )

2024-01-18 14:26:33 -08:00

test_usage_common.py

feat(ingest/usage): Make cumulative query character limit configurable (#8751 )

2023-08-30 15:53:08 -04:00

test_utilities.py

fix(ingest): better logging line attribution (#9876 )

2024-02-21 11:37:57 -08:00

test_vertica_source.py

…

test_workunit.py

test(ingest): Aspect level golden file comparison (#8310 )

2023-07-11 10:39:47 -04:00