datahub

api

feat(cli): add support for sampled reporting to keep logs manageable (#5800 )

2022-09-01 14:47:28 -07:00

config

feat(ingest): reporting revamp, part 1 (#7031 )

2023-01-18 13:34:32 -08:00

data_lake

…

glue

refactor(ingest): subtypes - standardize (#7437 )

2023-02-28 13:11:07 -08:00

graph

chore(ingest): cleanup unused files/vars in tests (#7450 )

2023-02-28 08:07:34 +01:00

reporting

feat(ingestion): send reports of ingestion runs to datahub (#5639 )

2022-08-19 09:08:17 -07:00

sagemaker

feat(ingest): avoid embedding serialized json in metadata files (#6742 )

2022-12-28 19:28:38 -05:00

schema

fix(ingest): json-schema - nullability handling (#7667 )

2023-03-23 23:07:30 +00:00

serde

feat(ingest): add urn modification helper (#7440 )

2023-03-16 13:27:08 -07:00

stateful_ingestion

feat(sdk): support executing graphql via DataHubGraph (#7753 )

2023-04-12 11:30:05 -07:00

utilities

chore(ingest): enable flake8 bugbear linting (#7763 )

2023-04-10 14:14:42 -07:00

__init__.py

…

test_airflow.py

feat(ingest): mark database_alias and env as deprecated (#6901 )

2023-01-09 19:58:19 +05:30

test_allow_deny.py

chore(ingest): remove inferred args to MCPW, part 1 (#6819 )

2022-12-30 01:26:47 -05:00

test_apis.py

…

test_athena_source.py

refactor(ingest/athena): Replace s3_staging_dir parameter in Athena source with query_result_location (#7044 )

2023-01-18 09:25:37 -08:00

test_bigquery_lineage.py

fix(ingest/bigquery): Lineage edges use datetime with timezone; correctly parse last_altered (#7762 )

2023-04-06 02:46:50 +00:00

test_bigquery_profiler.py

fix(ingest/bigquery): Fix for table cache was not cleared (#7323 )

2023-02-13 19:04:19 +01:00

test_bigquery_source.py

fix(ingest/bigquery): Raise report_failure threshold; add robustness around table parsing (#7772 )

2023-04-06 13:24:22 -07:00

test_bigquery_sql_lineage.py

refactor(ingest): bigquery-lineage - allow tables and datasets in uppercase (#6739 )

2022-12-14 14:58:03 +01:00

test_bigquery_sql_parser.py

test(ingest/bigquery): Add sql parser xfail test to fix later (#7792 )

2023-04-12 10:51:29 -07:00

test_bigquery_usage.py

perf(ingest/bigquery): Improve bigquery usage disk usage and speed (#7825 )

2023-04-14 18:09:43 -07:00

test_bigqueryv2_usage_source.py

fix(ingest): bigquery - sharded table support improvements (#6789 )

2022-12-19 18:57:37 +01:00

test_bq_get_partition_range.py

deprecate(ingest): bigquery - Removing bigquery-legacy source (#6851 )

2022-12-29 13:19:05 -08:00

test_capability_report.py

fix(ingest): fix serialization of report to handle nesting (#5455 )

2022-07-20 18:25:07 -07:00

test_check_upgrade.py

chore(ingest): formatting + cleanup MCPW usages (#7706 )

2023-03-29 11:43:25 -07:00

test_check.py

…

test_classification.py

feat(ingest): automated term classification for snowflake (#6376 )

2022-11-23 00:43:30 -05:00

test_cli_logging.py

fix(ingest): prevent logging from blowing up on TypeErrors (#7497 )

2023-03-03 14:36:55 -08:00

test_cli_utils.py

feat(cli,build): remove deprecated variables GMS_HOST/_PORT (#5451 )

2022-07-20 20:54:43 +05:30

test_clickhouse_source.py

fix(ingest): bigquery - sharded table support improvements (#6789 )

2022-12-19 18:57:37 +01:00

test_codegen.py

feat(model): fully populate the entity registry (#7818 )

2023-04-15 13:33:05 -07:00

test_config_clean.py

…

test_confluent_schema_registry.py

…

test_corp_group_urn.py

…

test_corpuser_urn.py

…

test_csv_enricher_source.py

feat(ingest): infer aspect name from type in get_aspect (#6033 )

2022-10-11 13:35:41 -07:00

test_data_flow_urn.py

…

test_data_job_urn.py

…

test_data_process_instance_urn.py

feat(ingest): airflow - add support to capture airflow executions, add high level dataflow jobs api to python sdk (#4615 )

2022-04-12 23:19:39 -07:00

test_dataset_urn.py

…

test_dbt_source.py

fix(ingest/dbt): introduce lowercase column urn option (#7418 )

2023-03-20 10:37:19 -07:00

test_domain_urn.py

…

test_druid_source.py

fix(ingest): bigquery - sharded table support improvements (#6789 )

2022-12-19 18:57:37 +01:00

test_elasticsearch_source.py

refactor(ingest): move common host_port validation (#6009 )

2022-09-22 16:32:07 -07:00

test_file_lineage_source.py

refactor(ingest): Minor cleanup of File, CsvEnricher, BusinessGlossary, and FileLineage sources (#7718 )

2023-03-31 15:49:24 -07:00

test_glue_source_stubs.py

feat(glue): allow resource links to be ignored (#7639 )

2023-04-21 10:42:32 -07:00

test_glue_source.py

feat(glue): allow resource links to be ignored (#7639 )

2023-04-21 10:42:32 -07:00

test_great_expectations_action.py

chore(ci): upgrade GE version (#7290 )

2023-03-02 10:47:38 -08:00

test_hana_source.py

fix(build): fix for hana build failure for aarch64. (#5019 )

2022-05-26 15:29:21 -07:00

test_hive_source.py

fix(ingest): bigquery - sharded table support improvements (#6789 )

2022-12-19 18:57:37 +01:00

test_iceberg.py

chore(ingest): drop python 3.6 support (#5521 )

2022-08-10 15:00:31 -07:00

test_kafka_emitter.py

refactor(ingest): move common host_port validation (#6009 )

2022-09-22 16:32:07 -07:00

test_kafka_sink.py

chore(ingest): remove inferred args to MCPW, part 2 (#6905 )

2023-01-04 23:29:56 -05:00

test_kafka_source.py

fix(ingest/kafka): Remove topic from kafka browse path (#7398 )

2023-02-22 18:38:08 -05:00

test_key_value_pattern.py

feat(ingest): add fallthrough support to KeyValuePattern (#6302 )

2022-10-28 11:07:47 +02:00

test_ldap_source.py

fix(ingest): bigquery - sharded table support improvements (#6789 )

2022-12-19 18:57:37 +01:00

test_ldap_state.py

refactor(ingest/stateful): remove most remaining state classes (#6791 )

2022-12-19 13:40:48 -05:00

test_mapping.py

feat(ingest): dbt - improving dbt_meta mapping (#5237 )

2022-06-24 13:43:12 +02:00

test_mariadb_source.py

…

test_mce_builder.py

fix(ingest): encode reserved characters when creating dataset urn (#5977 )

2022-09-20 16:59:02 -07:00

test_mce_helpers.py

…

test_mcp_builder.py

feat(ingest): avoid embedding serialized json in metadata files (#6742 )

2022-12-28 19:28:38 -05:00

test_mcp_wrapper.py

feat(ingest): avoid embedding serialized json in metadata files (#6742 )

2022-12-28 19:28:38 -05:00

test_nifi_source.py

fix(ingest): bigquery - sharded table support improvements (#6789 )

2022-12-19 18:57:37 +01:00

test_notebook_urn.py

…

test_openapi.py

fix(ingest): bigquery - sharded table support improvements (#6789 )

2022-12-19 18:57:37 +01:00

test_oracle_source.py

…

test_packages.py

test(cli): add check for missing init files (#7378 )

2023-02-20 18:41:12 +05:30

test_packaging.py

…

test_parsing_util.py

…

test_pipeline.py

fix(misc): misc fixes (#7633 )

2023-03-21 19:42:50 +05:30

test_plugin_system.py

chore(ingest): enable flake8 bugbear linting (#7763 )

2023-04-10 14:14:42 -07:00

test_postgres_source.py

feat(ingest/postgres): support extracting metadata from all databases in single recipe (#7581 )

2023-03-28 14:16:12 -07:00

test_protobuf_util.py

fix(ingest): bigquery - sharded table support improvements (#6789 )

2022-12-19 18:57:37 +01:00

test_pulsar_source.py

feat(ingestion): add Pulsar source (#4721 )

2022-04-29 15:57:02 +05:30

test_pydantic_validators.py

feat(ingest/snowflake): hide host_port from snowflake docs (#7717 )

2023-03-31 15:58:52 +05:30

test_redash_source.py

fix(ingest): redash - fix redash dashboard url bug (#5500 )

2022-08-16 13:39:27 -07:00

test_report.py

feat(ingest): reporting revamp, part 1 (#7031 )

2023-01-18 13:34:32 -08:00

test_rest_emitter.py

docs(): generate docs for our Python SDK (#7612 )

2023-03-28 20:23:20 -07:00

test_rest_sink.py

feat(ingest): fix handling of unions with aliases in post restli conversion (#7058 )

2023-01-18 09:29:46 -08:00

test_sagemaker_source_stubs.py

…

test_schema_util.py

fix(ingest): kafka - properly picking doc from union type (#6472 )

2022-11-23 20:42:21 +01:00

test_snowflake_source.py

test(ingest/snowflake): fix tests around host_port (#7791 )

2023-04-11 16:06:35 -07:00

test_source_helpers.py

fix(ingest): fix bug in auto_status_aspect (#6705 )

2022-12-09 12:24:39 -05:00

test_source.py

chore(ingest): remove inferred args to MCPW, part 2 (#6905 )

2023-01-04 23:29:56 -05:00

test_sql_common.py

refactor(ingest/containers): Refactoring container creation to common place (#6877 )

2023-01-21 00:14:31 +01:00

test_sql_utils.py

refactor(ingest/containers): Refactoring container creation to common place (#6877 )

2023-01-21 00:14:31 +01:00

test_superset_source.py

fix(ingest/superset): support superset v2 (#7588 )

2023-03-20 19:49:32 -07:00

test_tag_urn.py

…

test_transform_dataset.py

chore(ingest): enable flake8 bugbear linting (#7763 )

2023-04-10 14:14:42 -07:00

test_urn.py

…

test_usage_common.py

fix(ingest/bigquery): Support cross project usage using FileBackedDict (#7663 )

2023-04-07 12:18:26 -07:00

test_utilities.py

fix(ingest): bigquery - sharded table support improvements (#6789 )

2022-12-19 18:57:37 +01:00

test_vertica_source.py

fix(ingest): bigquery - sharded table support improvements (#6789 )

2022-12-19 18:57:37 +01:00