datahub

api

feat(cli): add support for sampled reporting to keep logs manageable (#5800 )

2022-09-01 14:47:28 -07:00

config

feat(ingest): redact configs reported in ingestion_run_summary (#6696 )

2022-12-12 10:48:26 +01:00

data_lake

…

glue

feat(ingest): include instance in container dataPlatform when provided (#6083 )

2022-10-13 11:29:54 -07:00

graph

fix(python-sdk): DataHubGraph get_aspect should accept empty responses (#6760 )

2022-12-14 10:40:16 -08:00

reporting

feat(ingestion): send reports of ingestion runs to datahub (#5639 )

2022-08-19 09:08:17 -07:00

sagemaker

refactor(ingestion): Browse Paths Upgrade V2 Feast & Sagemaker (#6002 )

2022-12-21 08:02:59 -08:00

serde

fix(ingest): bigquery - sharded table support improvements (#6789 )

2022-12-19 18:57:37 +01:00

stateful_ingestion

feat(ingest/stateful): remove platform_instance_id from state urn (#6795 )

2022-12-20 12:12:19 -05:00

utilities

fix(ingest): bigquery-beta - Adding python 3.8 fix for memory footprint util (#6228 )

2022-10-18 17:59:31 -07:00

__init__.py

…

test_airflow.py

docs(ingest): add airflow docs that use the PythonVirtualenvOperator (#6604 )

2022-12-02 19:56:17 +01:00

test_allow_deny.py

…

test_apis.py

…

test_athena_source.py

feat(ingest): loosen sqlalchemy dep & support airflow 2.3+ (#6204 )

2022-11-11 15:04:36 -05:00

test_bigquery_lineage.py

fix(ingest): profiling - Changing profiling defaults on Bigquery and Snowflake (#6640 )

2022-12-07 10:33:10 +01:00

test_bigquery_source.py

fix(ingest): bigquery - sharded table support improvements (#6789 )

2022-12-19 18:57:37 +01:00

test_bigquery_sql_lineage.py

refactor(ingest): bigquery-lineage - allow tables and datasets in uppercase (#6739 )

2022-12-14 14:58:03 +01:00

test_bigquery_sql_parser.py

fix(parsing): incorrect parsing for commas (#5027 )

2022-05-27 22:22:13 +05:30

test_bigquery_usage_source.py

fix(ingest): bigquery - sharded table support improvements (#6789 )

2022-12-19 18:57:37 +01:00

test_bigqueryv2_usage_source.py

fix(ingest): bigquery - sharded table support improvements (#6789 )

2022-12-19 18:57:37 +01:00

test_bq_get_partition_range.py

fix(ingest): bigquery - Fix BigQuery Datetime/Timestamp type column partition table profile bug (#4658 )

2022-04-26 16:54:19 +02:00

test_capability_report.py

fix(ingest): fix serialization of report to handle nesting (#5455 )

2022-07-20 18:25:07 -07:00

test_check.py

…

test_classification.py

feat(ingest): automated term classification for snowflake (#6376 )

2022-11-23 00:43:30 -05:00

test_cli_utils.py

feat(cli,build): remove deprecated variables GMS_HOST/_PORT (#5451 )

2022-07-20 20:54:43 +05:30

test_clickhouse_source.py

fix(ingest): bigquery - sharded table support improvements (#6789 )

2022-12-19 18:57:37 +01:00

test_config_clean.py

…

test_confluent_schema_registry.py

…

test_corp_group_urn.py

…

test_corpuser_urn.py

…

test_csv_enricher_source.py

feat(ingest): infer aspect name from type in get_aspect (#6033 )

2022-10-11 13:35:41 -07:00

test_data_flow_urn.py

feat(ingest): add Urn python library for DataJob, DataFlow, Domain and Tag (#4618 )

2022-04-12 09:02:28 +02:00

test_data_job_urn.py

feat(ingest): add Urn python library for DataJob, DataFlow, Domain and Tag (#4618 )

2022-04-12 09:02:28 +02:00

test_data_process_instance_urn.py

feat(ingest): airflow - add support to capture airflow executions, add high level dataflow jobs api to python sdk (#4615 )

2022-04-12 23:19:39 -07:00

test_dataset_urn.py

…

test_dbt_source.py

feat(ingest): dbt cloud integration (#6323 )

2022-11-21 14:14:33 -05:00

test_domain_urn.py

feat(ingest): add Urn python library for DataJob, DataFlow, Domain and Tag (#4618 )

2022-04-12 09:02:28 +02:00

test_druid_source.py

fix(ingest): bigquery - sharded table support improvements (#6789 )

2022-12-19 18:57:37 +01:00

test_elasticsearch_source.py

refactor(ingest): move common host_port validation (#6009 )

2022-09-22 16:32:07 -07:00

test_file_lineage_source.py

…

test_glue_source_stubs.py

feat: qualifiedName support + populating glue ARN (#5952 )

2022-09-15 21:15:03 -07:00

test_glue_source.py

feat(ingest): start simplifying stateful ingestion state (#6740 )

2022-12-13 10:05:57 +01:00

test_great_expectations_action.py

fix(ingest): bigquery - sharded table support improvements (#6789 )

2022-12-19 18:57:37 +01:00

test_hana_source.py

fix(build): fix for hana build failure for aarch64. (#5019 )

2022-05-26 15:29:21 -07:00

test_hive_source.py

fix(ingest): bigquery - sharded table support improvements (#6789 )

2022-12-19 18:57:37 +01:00

test_iceberg.py

chore(ingest): drop python 3.6 support (#5521 )

2022-08-10 15:00:31 -07:00

test_kafka_emitter.py

refactor(ingest): move common host_port validation (#6009 )

2022-09-22 16:32:07 -07:00

test_kafka_sink.py

feat(ingest): make sink use type annotations (#5899 )

2022-09-10 19:46:20 -07:00

test_kafka_source.py

feat(ingest): extract kafka topic config properties as customProperties (#6783 )

2022-12-22 09:34:55 +01:00

test_key_value_pattern.py

feat(ingest): add fallthrough support to KeyValuePattern (#6302 )

2022-10-28 11:07:47 +02:00

test_ldap_source.py

fix(ingest): bigquery - sharded table support improvements (#6789 )

2022-12-19 18:57:37 +01:00

test_ldap_state.py

refactor(ingest/stateful): remove most remaining state classes (#6791 )

2022-12-19 13:40:48 -05:00

test_mapping.py

feat(ingest): dbt - improving dbt_meta mapping (#5237 )

2022-06-24 13:43:12 +02:00

test_mariadb_source.py

…

test_mce_builder.py

fix(ingest): encode reserved characters when creating dataset urn (#5977 )

2022-09-20 16:59:02 -07:00

test_mce_helpers.py

…

test_mcp_builder.py

feat(ingest): include instance in container dataPlatform when provided (#6083 )

2022-10-13 11:29:54 -07:00

test_nifi_source.py

fix(ingest): bigquery - sharded table support improvements (#6789 )

2022-12-19 18:57:37 +01:00

test_notebook_urn.py

…

test_openapi.py

fix(ingest): bigquery - sharded table support improvements (#6789 )

2022-12-19 18:57:37 +01:00

test_oracle_source.py

…

test_packaging.py

…

test_parsing_util.py

…

test_pipeline.py

refactor(ingest/stateful): remove IngestionJobStateProvider (#6792 )

2022-12-19 17:03:54 -05:00

test_plugin_system.py

feat(ingest): add support for aliases in plugin registry (#5958 )

2022-09-16 07:19:32 -07:00

test_postgres_source.py

…

test_protobuf_util.py

fix(ingest): bigquery - sharded table support improvements (#6789 )

2022-12-19 18:57:37 +01:00

test_pulsar_source.py

feat(ingestion): add Pulsar source (#4721 )

2022-04-29 15:57:02 +05:30

test_redash_source.py

fix(ingest): redash - fix redash dashboard url bug (#5500 )

2022-08-16 13:39:27 -07:00

test_rest_emitter.py

…

test_rest_sink.py

…

test_sagemaker_source_stubs.py

…

test_schema_util.py

fix(ingest): kafka - properly picking doc from union type (#6472 )

2022-11-23 20:42:21 +01:00

test_snowflake_beta_source.py

fix(ingest): bigquery - sharded table support improvements (#6789 )

2022-12-19 18:57:37 +01:00

test_source_helpers.py

fix(ingest): fix bug in auto_status_aspect (#6705 )

2022-12-09 12:24:39 -05:00

test_source.py

test(ingestion): change class names to avoid unittest warnings (#5005 )

2022-05-26 22:09:40 +05:30

test_sql_common.py

chore(ingest): bump and pin mypy (#6584 )

2022-12-02 19:53:28 +01:00

test_superset_source.py

fix(ingest): bigquery - sharded table support improvements (#6789 )

2022-12-19 18:57:37 +01:00

test_tag_urn.py

feat(ingest): add Urn python library for DataJob, DataFlow, Domain and Tag (#4618 )

2022-04-12 09:02:28 +02:00

test_transform_dataset.py

fix(ingest): bigquery - sharded table support improvements (#6789 )

2022-12-19 18:57:37 +01:00

test_urn.py

feat(ingest): add Urn python library for DataJob, DataFlow, Domain and Tag (#4618 )

2022-04-12 09:02:28 +02:00

test_usage_common.py

feat(ingest): snowflake-beta - minor changes, tests (#5910 )

2022-09-12 10:42:52 -07:00

test_utilities.py

fix(ingest): bigquery - sharded table support improvements (#6789 )

2022-12-19 18:57:37 +01:00

test_vertica_source.py

fix(ingest): bigquery - sharded table support improvements (#6789 )

2022-12-19 18:57:37 +01:00