datahub

config

fix(config-parsing): add support for variable expansion for in variables in between string (#4350 )

2022-03-08 12:24:08 -08:00

data_lake

feat(ingest): data-lake - remove spark requirement if not profiling (#4131 )

2022-02-24 23:26:06 -08:00

glue

feat(ingestion): glue/s3 - Ingest Tags from s3 bucket on an AWS Glue job and S3 Data Lake Ingest Job (#4689 )

2022-04-29 10:09:06 +02:00

sagemaker

feat(ingest): data-lake - remove spark requirement if not profiling (#4131 )

2022-02-24 23:26:06 -08:00

serde

fix(ingestion): enable compat with avro 1.11 (#4205 )

2022-02-22 22:13:50 -08:00

stateful_ingestion

feat(ingestion): Kafka stateful ingestion (#4028 )

2022-02-15 07:18:36 -08:00

__init__.py

feat(ingest): add support for Glue ETL jobs (#2687 )

2021-06-22 11:33:22 -07:00

test_airflow.py

feat(ingest): airflow - add support to capture airflow executions, add high level dataflow jobs api to python sdk (#4615 )

2022-04-12 23:19:39 -07:00

test_allow_deny.py

fix(ingest): apply case insensitive regex matching by default (#3067 )

2021-08-10 10:35:57 -07:00

test_apis.py

fix(ingest): enable mypy disallow_incomplete_defs and disallow_untyped_decorators (#2393 )

2021-04-14 13:40:24 -07:00

test_athena_source.py

chore: fix lint and remove incorrect integration mark from unit tests (#4621 )

2022-04-08 17:18:48 +02:00

test_bigquery_source.py

fix(bigquery): fix lineage bug, improve docs, add dataset filter config (#4607 )

2022-04-07 13:10:21 -07:00

test_bigquery_usage_source.py

chore: fix lint and remove incorrect integration mark from unit tests (#4621 )

2022-04-08 17:18:48 +02:00

test_bq_get_partition_range.py

fix(ingest): bigquery - Fix BigQuery Datetime/Timestamp type column partition table profile bug (#4658 )

2022-04-26 16:54:19 +02:00

test_check.py

refactor(test): replace CliRunner with run_datahub_cmd method (#3746 )

2021-12-16 20:07:38 -08:00

test_cli_utils.py

feat(ingest): support for env variable in cli (#3215 )

2021-09-16 23:18:42 -07:00

test_clickhouse_source.py

chore: fix lint and remove incorrect integration mark from unit tests (#4621 )

2022-04-08 17:18:48 +02:00

test_config_clean.py

feat(ingestion): improve logging, docs for bigquery, snowflake, redshift (#4344 )

2022-03-14 08:50:29 -07:00

test_confluent_schema_registry.py

feat(ingestion): Support pluggable Schema Registry for Kafka Source (#4535 )

2022-03-30 13:20:23 -07:00

test_corp_group_urn.py

feat(ingest): add python utility classes for NotebookUrn, CorpuserUrn and CorpGroupUrn (#4469 )

2022-03-23 16:07:57 -07:00

test_corpuser_urn.py

feat(ingest): add python utility classes for NotebookUrn, CorpuserUrn and CorpGroupUrn (#4469 )

2022-03-23 16:07:57 -07:00

test_data_flow_urn.py

feat(ingest): add Urn python library for DataJob, DataFlow, Domain and Tag (#4618 )

2022-04-12 09:02:28 +02:00

test_data_job_urn.py

feat(ingest): add Urn python library for DataJob, DataFlow, Domain and Tag (#4618 )

2022-04-12 09:02:28 +02:00

test_data_process_instance_urn.py

feat(ingest): airflow - add support to capture airflow executions, add high level dataflow jobs api to python sdk (#4615 )

2022-04-12 23:19:39 -07:00

test_dataset_urn.py

feat(ingest): lib - add better support for working with urns (#4172 )

2022-02-22 19:39:24 -08:00

test_dbt_source.py

feat(ingest): dbt - add support for dbt meta mapping (#3832 )

2022-01-05 16:32:05 -08:00

test_domain_urn.py

feat(ingest): add Urn python library for DataJob, DataFlow, Domain and Tag (#4618 )

2022-04-12 09:02:28 +02:00

test_druid_source.py

chore: fix lint and remove incorrect integration mark from unit tests (#4621 )

2022-04-08 17:18:48 +02:00

test_elasticsearch_source.py

fix(ingest): elasticsearch - http/https host config support (#4191 )

2022-02-19 11:42:01 -08:00

test_file_lineage_source.py

feat(ingest): lineage-file - add ability to provide lineage manually through a file (#4116 )

2022-02-24 17:02:38 -08:00

test_glue_source_stubs.py

feat(ingestion): glue/s3 - Ingest Tags from s3 bucket on an AWS Glue job and S3 Data Lake Ingest Job (#4689 )

2022-04-29 10:09:06 +02:00

test_glue_source.py

feat(ingestion): glue/s3 - Ingest Tags from s3 bucket on an AWS Glue job and S3 Data Lake Ingest Job (#4689 )

2022-04-29 10:09:06 +02:00

test_great_expectations_action.py

feat(assertions): Adding Assertions Entity & Great Expectations BETA (#4305 )

2022-03-04 11:51:31 -08:00

test_hive_source.py

chore: fix lint and remove incorrect integration mark from unit tests (#4621 )

2022-04-08 17:18:48 +02:00

test_kafka_emitter.py

feat(ingest): add kafka emitters for MetadataChangeProposal format (#3018 )

2021-08-03 11:17:16 -07:00

test_kafka_sink.py

feat(ingest): add kafka emitters for MetadataChangeProposal format (#3018 )

2021-08-03 11:17:16 -07:00

test_kafka_source.py

feat(ingest): docs - overhaul source connector docs to make it code driven (#4798 )

2022-05-02 00:18:15 -07:00

test_ldap_source.py

chore: fix lint and remove incorrect integration mark from unit tests (#4621 )

2022-04-08 17:18:48 +02:00

test_mapping.py

feat(ingest): dbt - add query tag mapping and match template (#4744 )

2022-04-25 10:56:45 -07:00

test_mariadb_source.py

feat(ingest): add mariadb as possible source (#3245 )

2021-10-12 23:27:47 -07:00

test_mce_builder.py

Revert "fix(ingest): Use lower-case dataset names in the dataset urns for all SQL-styled datasets. (#4140 )" (#4218 )

2022-02-22 16:21:40 -08:00

test_mce_helpers.py

feat(ingest): refactor mce comparison and add pytest update golden files option (#2812 )

2021-06-30 16:53:20 -07:00

test_mcp_builder.py

fix(ingestion) containers: Adding platform instance to container keys (#4279 )

2022-03-16 14:57:50 -07:00

test_nifi_source.py

feat(ingest): nifi - handle provenance api variation for older versions (#4022 )

2022-02-01 10:03:05 -08:00

test_notebook_urn.py

feat(ingest): add python utility classes for NotebookUrn, CorpuserUrn and CorpGroupUrn (#4469 )

2022-03-23 16:07:57 -07:00

test_openapi.py

fix(ingest): handle endpoints without 200 response in openapi (#4332 )

2022-03-14 17:52:08 -07:00

test_oracle_source.py

fix(ingest): patch lookml types and refactor ingestion sources layout (#2950 )

2021-07-26 13:06:52 -07:00

test_packaging.py

test(ingestion): fix flaky package discovery test (#2949 )

2021-07-25 21:15:22 -07:00

test_parsing_util.py

feat(ingestion): snowflake, bigquery - enhancements to log and bugfix (#4442 )

2022-03-21 09:50:36 -07:00

test_pipeline.py

fix(ingest): fwk - datahub_api should be initialized by datahub-rest … (#4786 )

2022-04-28 22:31:19 -07:00

test_plugin_system.py

feat(ingest): Adding Tableau Source Connector [BETA] (#4063 )

2022-02-08 14:26:44 -08:00

test_postgres_source.py

fix(ingest): patch lookml types and refactor ingestion sources layout (#2950 )

2021-07-26 13:06:52 -07:00

test_pulsar_source.py

feat(ingestion): add Pulsar source (#4721 )

2022-04-29 15:57:02 +05:30

test_redash_source.py

Revert "fix(ingest): Use lower-case dataset names in the dataset urns for all SQL-styled datasets. (#4140 )" (#4218 )

2022-02-22 16:21:40 -08:00

test_rest_emitter.py

feat(ingest): datahub-rest - Make datahub-rest client more robust by configurable retries. (#3826 ) (#3860 )

2022-01-11 19:35:06 -08:00

test_rest_sink.py

Introducing TimeSeries Aspects + Dataset Profile (Stats) Aspect (#2983 )

2021-07-30 17:41:03 -07:00

test_sagemaker_source_stubs.py

feat(ingest): type stubs for boto3 (#2975 )

2021-07-28 20:35:35 -07:00

test_schema_util.py

Fix bug in the SchemaField type computation for AVRO logical types. (#4433 )

2022-03-18 12:06:54 +01:00

test_snowflake_source.py

fix(snowflake): deprecate config, update examples (#4644 )

2022-04-20 15:21:09 -07:00

test_source.py

feat(ingest): transformers - add support for processing MCP-s (#4337 )

2022-03-07 13:14:29 -08:00

test_sql_common.py

feat(ingest): add trino platform for great expectations (#4594 )

2022-04-11 19:48:15 -07:00

test_tag_urn.py

feat(ingest): add Urn python library for DataJob, DataFlow, Domain and Tag (#4618 )

2022-04-12 09:02:28 +02:00

test_transform_dataset.py

feat(ingest): transformers - add support for processing MCP-s (#4337 )

2022-03-07 13:14:29 -08:00

test_urn.py

feat(ingest): add Urn python library for DataJob, DataFlow, Domain and Tag (#4618 )

2022-04-12 09:02:28 +02:00

test_usage_common.py

feat(ingest): indent sql queries for usage sources (#3782 )

2022-03-31 15:15:09 -07:00

test_utilities.py

fix(bigquery): error due to not handling date properly (#4702 )

2022-04-20 18:14:33 +02:00