datahub

api

feat(cli): add support for sampled reporting to keep logs manageable (#5800 )

2022-09-01 14:47:28 -07:00

config

feat(ingest): list referenced env variables in recipe (#6043 )

2022-09-26 23:16:18 -07:00

data_lake

feat(ingest): data-lake - remove spark requirement if not profiling (#4131 )

2022-02-24 23:26:06 -08:00

glue

feat: qualifiedName support + populating glue ARN (#5952 )

2022-09-15 21:15:03 -07:00

reporting

feat(ingestion): send reports of ingestion runs to datahub (#5639 )

2022-08-19 09:08:17 -07:00

sagemaker

feat(ingest): data-lake - remove spark requirement if not profiling (#4131 )

2022-02-24 23:26:06 -08:00

serde

fix(ingest): avrogen handling for missing fields with default values (#5844 )

2022-09-08 14:05:28 -07:00

stateful_ingestion

fix(ingestion): fix percent change computation in stale_entity_removal (#6121 )

2022-10-04 20:40:59 -07:00

utilities

fix(ingest): presto-on-hive - not failing on Hive type parsing error (#6118 )

2022-10-04 20:54:38 -07:00

__init__.py

…

test_airflow.py

chore(ingest): drop python 3.6 support (#5521 )

2022-08-10 15:00:31 -07:00

test_allow_deny.py

fix(ingest): apply case insensitive regex matching by default (#3067 )

2021-08-10 10:35:57 -07:00

test_apis.py

…

test_athena_source.py

chore(ingest): drop python 3.6 support (#5521 )

2022-08-10 15:00:31 -07:00

test_bigquery_source.py

docs(bigquery): add changelog and unittest for profiling limits (#5407 )

2022-07-19 09:39:09 +05:30

test_bigquery_sql_lineage.py

fix(bigquery): improve handling of extracted audit log sql queries (#4735 )

2022-05-03 14:43:23 +05:30

test_bigquery_sql_parser.py

fix(parsing): incorrect parsing for commas (#5027 )

2022-05-27 22:22:13 +05:30

test_bigquery_usage_source.py

fix(ingest): bigquery-beta - handling complex types properly (#6062 )

2022-09-27 21:31:24 +02:00

test_bigqueryv2_usage_source.py

fix(ingest): bigquery-beta - handling complex types properly (#6062 )

2022-09-27 21:31:24 +02:00

test_bq_get_partition_range.py

fix(ingest): bigquery - Fix BigQuery Datetime/Timestamp type column partition table profile bug (#4658 )

2022-04-26 16:54:19 +02:00

test_capability_report.py

fix(ingest): fix serialization of report to handle nesting (#5455 )

2022-07-20 18:25:07 -07:00

test_check.py

refactor(test): replace CliRunner with run_datahub_cmd method (#3746 )

2021-12-16 20:07:38 -08:00

test_cli_utils.py

feat(cli,build): remove deprecated variables GMS_HOST/_PORT (#5451 )

2022-07-20 20:54:43 +05:30

test_clickhouse_source.py

fix(ingest): Fix ingest Clickhouse without password (#5511 )

2022-08-09 10:30:56 -07:00

test_config_clean.py

feat(ingestion): improve logging, docs for bigquery, snowflake, redshift (#4344 )

2022-03-14 08:50:29 -07:00

test_confluent_schema_registry.py

feat(ingestion): Support pluggable Schema Registry for Kafka Source (#4535 )

2022-03-30 13:20:23 -07:00

test_corp_group_urn.py

feat(ingest): add python utility classes for NotebookUrn, CorpuserUrn and CorpGroupUrn (#4469 )

2022-03-23 16:07:57 -07:00

test_corpuser_urn.py

feat(ingest): add python utility classes for NotebookUrn, CorpuserUrn and CorpGroupUrn (#4469 )

2022-03-23 16:07:57 -07:00

test_csv_enricher_source.py

feat(ingest): infer aspectName from aspect type in MCP (#5566 )

2022-08-07 07:52:58 -07:00

test_data_flow_urn.py

feat(ingest): add Urn python library for DataJob, DataFlow, Domain and Tag (#4618 )

2022-04-12 09:02:28 +02:00

test_data_job_urn.py

feat(ingest): add Urn python library for DataJob, DataFlow, Domain and Tag (#4618 )

2022-04-12 09:02:28 +02:00

test_data_process_instance_urn.py

feat(ingest): airflow - add support to capture airflow executions, add high level dataflow jobs api to python sdk (#4615 )

2022-04-12 23:19:39 -07:00

test_dataset_urn.py

feat(ingest): lib - add better support for working with urns (#4172 )

2022-02-22 19:39:24 -08:00

test_dbt_source.py

feat(ingest): dbt - control over emitting test_results, test_definitions, etc. (#5328 )

2022-08-06 21:42:53 -07:00

test_domain_urn.py

feat(ingest): add Urn python library for DataJob, DataFlow, Domain and Tag (#4618 )

2022-04-12 09:02:28 +02:00

test_druid_source.py

chore: fix lint and remove incorrect integration mark from unit tests (#4621 )

2022-04-08 17:18:48 +02:00

test_elasticsearch_source.py

refactor(ingest): move common host_port validation (#6009 )

2022-09-22 16:32:07 -07:00

test_file_lineage_source.py

feat(ingest): lineage-file - add ability to provide lineage manually through a file (#4116 )

2022-02-24 17:02:38 -08:00

test_glue_source_stubs.py

feat: qualifiedName support + populating glue ARN (#5952 )

2022-09-15 21:15:03 -07:00

test_glue_source.py

feat(ingestion): Add fail-safe stale entity removal via configurable 'fail_safe_threshold' param. (#6027 )

2022-09-22 16:09:22 -07:00

test_great_expectations_action.py

feat(assertions): Adding Assertions Entity & Great Expectations BETA (#4305 )

2022-03-04 11:51:31 -08:00

test_hana_source.py

fix(build): fix for hana build failure for aarch64. (#5019 )

2022-05-26 15:29:21 -07:00

test_hive_source.py

chore: fix lint and remove incorrect integration mark from unit tests (#4621 )

2022-04-08 17:18:48 +02:00

test_iceberg.py

chore(ingest): drop python 3.6 support (#5521 )

2022-08-10 15:00:31 -07:00

test_kafka_emitter.py

refactor(ingest): move common host_port validation (#6009 )

2022-09-22 16:32:07 -07:00

test_kafka_sink.py

feat(ingest): make sink use type annotations (#5899 )

2022-09-10 19:46:20 -07:00

test_kafka_source.py

feat(ingestion): Add fail-safe stale entity removal via configurable 'fail_safe_threshold' param. (#6027 )

2022-09-22 16:09:22 -07:00

test_ldap_source.py

chore: fix lint and remove incorrect integration mark from unit tests (#4621 )

2022-04-08 17:18:48 +02:00

test_mapping.py

feat(ingest): dbt - improving dbt_meta mapping (#5237 )

2022-06-24 13:43:12 +02:00

test_mariadb_source.py

feat(ingest): add mariadb as possible source (#3245 )

2021-10-12 23:27:47 -07:00

test_mce_builder.py

fix(ingest): encode reserved characters when creating dataset urn (#5977 )

2022-09-20 16:59:02 -07:00

test_mce_helpers.py

…

test_mcp_builder.py

feat(ingest): add entity type inference to mcpw (#5880 )

2022-09-10 20:36:10 -07:00

test_nifi_source.py

feat(ingest): nifi - handle provenance api variation for older versions (#4022 )

2022-02-01 10:03:05 -08:00

test_notebook_urn.py

feat(ingest): add python utility classes for NotebookUrn, CorpuserUrn and CorpGroupUrn (#4469 )

2022-03-23 16:07:57 -07:00

test_openapi.py

fix(ingest): handle endpoints without 200 response in openapi (#4332 )

2022-03-14 17:52:08 -07:00

test_oracle_source.py

fix(ingest): patch lookml types and refactor ingestion sources layout (#2950 )

2021-07-26 13:06:52 -07:00

test_packaging.py

…

test_parsing_util.py

feat(ingestion): snowflake, bigquery - enhancements to log and bugfix (#4442 )

2022-03-21 09:50:36 -07:00

test_pipeline.py

fix(ingest): datahub-api - move instantiation to the right config class (#5878 )

2022-09-09 13:34:21 -07:00

test_plugin_system.py

feat(ingest): add support for aliases in plugin registry (#5958 )

2022-09-16 07:19:32 -07:00

test_postgres_source.py

fix(ingest): patch lookml types and refactor ingestion sources layout (#2950 )

2021-07-26 13:06:52 -07:00

test_protobuf_util.py

chore(ingest): drop python 3.6 support (#5521 )

2022-08-10 15:00:31 -07:00

test_pulsar_source.py

feat(ingestion): add Pulsar source (#4721 )

2022-04-29 15:57:02 +05:30

test_redash_source.py

fix(ingest): redash - fix redash dashboard url bug (#5500 )

2022-08-16 13:39:27 -07:00

test_rest_emitter.py

feat(ingest): datahub-rest - Make datahub-rest client more robust by configurable retries. (#3826 ) (#3860 )

2022-01-11 19:35:06 -08:00

test_rest_sink.py

Introducing TimeSeries Aspects + Dataset Profile (Stats) Aspect (#2983 )

2021-07-30 17:41:03 -07:00

test_sagemaker_source_stubs.py

feat(ingest): type stubs for boto3 (#2975 )

2021-07-28 20:35:35 -07:00

test_schema_util.py

fix(ingest): common - fix nullability determination for the AVRO fixed type. (#5023 )

2022-05-29 09:06:08 -07:00

test_snowflake_beta_source.py

feat(ingest): snowflake-beta - minor changes, tests (#5910 )

2022-09-12 10:42:52 -07:00

test_snowflake_source.py

feat(ingest): snowflake - test_connection add support for capability report (#5472 )

2022-07-26 09:29:57 -07:00

test_source.py

test(ingestion): change class names to avoid unittest warnings (#5005 )

2022-05-26 22:09:40 +05:30

test_sql_common.py

test(ingestion): change class names to avoid unittest warnings (#5005 )

2022-05-26 22:09:40 +05:30

test_superset_source.py

fix(superset): do not crash when display_uri is not set (#5711 )

2022-08-24 23:26:02 -07:00

test_tag_urn.py

feat(ingest): add Urn python library for DataJob, DataFlow, Domain and Tag (#4618 )

2022-04-12 09:02:28 +02:00

test_transform_dataset.py

feat(transformers): Add semantics & transform_aspect support in transformers (#5514 )

2022-09-06 14:44:14 -07:00

test_urn.py

feat(ingest): add Urn python library for DataJob, DataFlow, Domain and Tag (#4618 )

2022-04-12 09:02:28 +02:00

test_usage_common.py

feat(ingest): snowflake-beta - minor changes, tests (#5910 )

2022-09-12 10:42:52 -07:00

test_utilities.py

Fix sqllineage parser to handle special tokens with a hyphens in the table and column names. (#5748 )

2022-08-26 18:11:00 -07:00

test_vertica_source.py

feat(ingest): Add Source from Vertica (#4555 )

2022-05-26 03:26:28 -07:00