12076 Commits

Author SHA1 Message Date
Aseem Bansal
6804dab7df
docs(confluent): Add new topic names (#3825) 2022-01-05 08:13:49 -08:00
Dexter Lee
9d04aa1255
feat(mae/mcl): Make ingestAspect produce both MCLs and MAEs (#3737) 2022-01-04 18:24:30 -08:00
Danny L
255462c63c
docs: improve documentation for metadata retention (#3802) 2022-01-04 13:00:39 -08:00
Michael A. Schlosser
101275230e
feat(metadata-service): add Schema Registry support for TLS (#3804)
Co-authored-by: Mike Schlosser <michael.a.schlosser@optum.com>
2022-01-04 12:41:36 -08:00
Tamas Nemeth
286b42663c
fix(ingest): redshift - handle string type for Glue-backed tables (#3811) 2022-01-04 01:43:41 -08:00
Ravindra Lanka
81bc173630
fix(ingest): Make url an optional field of the DefaultConfig for business glossary source. (#3817) 2022-01-04 01:42:01 -08:00
Swaroop Jagadish
3e234a992c
feat(java-emitter): improvements to builder API-s, moving spark-lineage under metadata-integration/java (#3819) 2022-01-04 01:41:09 -08:00
RyanHolstien
40b673403a
docs(fix): fix broken reference (#3814) 2022-01-03 15:15:07 -08:00
Pramod Biligiri
83d6eef35d
docs(modeling): Add a link to MXE page inside the Metadata Modeling page (#3765) 2022-01-03 07:29:15 -08:00
Dexter Lee
76f9423581
feat(nocode): Add get entities v2 endpoint that can get without snapshot (#3738) 2022-01-03 07:19:46 -08:00
Michael A. Schlosser
56ede88d0a
Fix path to elastic definition in dev docker compose (#3808) 2022-01-03 07:01:22 -08:00
MugdhaHardikar-GSLab
c65609a84a
feat(datahub-client): add Java REST emitter (#3781) 2022-01-02 22:48:38 +05:30
Tamas Nemeth
450cdc1739
feat(snowflake-usage): Generate email address if not exists (#3791) 2021-12-29 08:14:18 -08:00
Aseem Bansal
895af09af2
docs(kafka): add example for ingestion from confluent cloud (#3789) v0.8.21 2021-12-28 07:17:03 -08:00
Gabe Lyons
e7b93796b0
fix(elastic): allow more time for re-indexing tasks (#3794) 2021-12-27 10:02:28 -08:00
Tamas Nemeth
5df5150e51
feat(ingest): Add config option to set Bigquery credential in source config (#3786) 2021-12-27 05:48:45 -08:00
Sergio Gómez Villamor
0f8458ad74
doc(transforms): adds doc for simple_add_dataset_properties transformer (#3790) 2021-12-27 05:46:09 -08:00
cccs-eric
2645881b08
fix(superset): fix Superset chart ingestion with an empty metric label (#3792) (#3793) 2021-12-27 05:44:37 -08:00
Tamas Nemeth
c2459056e2
docs(redshift): Updating Redshift permission prerequisites in doc (#3777) 2021-12-22 14:15:09 -08:00
RyanHolstien
d3a441f128
docs(docker): update troubleshooting steps (#3788) 2021-12-22 14:04:54 -08:00
Sergio Gómez Villamor
3fa22e1138
feat(transform): adds simple add dataset properties transform (#3778) 2021-12-22 08:51:38 -08:00
John Joyce
1a65ea76bb
feat(UI): Add "Getting Started" Modal on fresh deployment (#3773) 2021-12-21 19:22:47 -08:00
John Joyce
fa0c15535f
Add azure doc to sidebar (#3785) 2021-12-21 18:34:56 -08:00
cccs-eric
acd930d47e
docs(auth): add Microsoft Azure as an SSO provider (#3779) (#3780) 2021-12-21 18:03:22 -08:00
Gabe Lyons
3860205f00
fix header height (#3784) 2021-12-21 17:59:07 -08:00
Hyun Min Choi
e76d40b57a
fix(lkml): bump lkml version up to 1.1.2 to support sql_preamble expression (#3757) 2021-12-21 12:13:13 -08:00
Aseem Bansal
77e3641a50
fix(ingest): fix compatibility with google composer (#3774) v0.8.20 2021-12-20 12:47:56 -08:00
Tamas Nemeth
2ee1a78f4e
fix(ingestion): Fix for same schema foreign key reference (#3769) 2021-12-20 07:11:55 -08:00
xiphl
8cd1e91072
Upgrade to 3rd Apache patch for log4j (#3772) 2021-12-20 06:55:22 -08:00
John Joyce
110efa68b9
docs(snowflake): Adding documentation about required Snowflake Privileges (#3770) 2021-12-19 12:01:53 -08:00
Aseem Bansal
2770eb6813
docs(ingestion): Add details of sensitive info handling (#3767) 2021-12-19 11:37:32 -08:00
Tamas Nemeth
599edd22ae
fix(ingest): profiling - disable expensive profilers by default (#3759) 2021-12-17 17:17:25 -08:00
John Joyce
926b6eed4e
fix(deps): upgrade to logback 1.2.9 to address CVE-2021-42550 (#3771) 2021-12-17 17:16:11 -08:00
Hyun Min Choi
e73a30dc81
feat(ingest): bigquery - add support for parsing exported audit logs (#3680) 2021-12-17 17:05:21 -08:00
Harshal Sheth
22cef5f897
refactor(test): replace CliRunner with run_datahub_cmd method (#3746) 2021-12-16 20:07:38 -08:00
Ravindra Lanka
bd69e736ba
feat(Stateful Ingestion-2/3): Client side changes for checkpointing a source job state. (#3763)
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
2021-12-16 20:06:33 -08:00
jawadqu
b4eaa9e09e
feat(ingestion): Mode retry wait logic to avoid hitting Mode API rate limit (#3761) 2021-12-16 19:17:12 -08:00
Harshal Sheth
df2cb94ed8
feat(ingest): profiling add upper bound on combined query size (#3762) 2021-12-16 17:34:46 -08:00
MugdhaHardikar-GSLab
e6f8c1c17c
docs(ingest): spark-lineage update artifact name and version (#3760) 2021-12-16 13:55:25 -08:00
Gabi Maeztu
21fbfbba08
doc: Add IOMED as a DataHub adopter (#3758) 2021-12-16 08:49:42 -08:00
Harshal Sheth
c6f3ddf077
build(ingest): restrict latest mypy version (#3756) 2021-12-16 08:48:15 -08:00
John Joyce
5b5135be0b
fix(vuln): log4j vulnerability - bumping to 2.16.0 (#3755) 2021-12-15 11:07:45 -08:00
Ravindra Lanka
4b81ad6262
feat(Stateful Ingestion): 1/3 Stateful ingestion server changes (#3749) 2021-12-15 10:32:58 -08:00
Tamas Nemeth
1c1561c497
feat(ingest): skipping emitting metadata for duplicate tables from ingestion (#3753) 2021-12-15 09:15:03 -08:00
Sergio Gómez Villamor
c59c63e90d
feat: enables dbt metadata files to be loaded from URIs (#3739) 2021-12-15 09:11:39 -08:00
Harshal Sheth
adf9d2ead7
test(ingest): fix pytest warning for class starting with Test (#3745) 2021-12-14 22:44:42 -08:00
John Joyce
1f53e0b610
refactor(auth): Remove base64 decoding of token service signing key (#3747) 2021-12-14 22:43:38 -08:00
varunbharill
70d068892e
fix(ingest): snowflake honor allow/deny pattern for lineage and usage. (#3748) 2021-12-14 20:42:29 -08:00
Gabe Lyons
2e2ed34250
feat(ingest): snowflake-usage add knob for direct objects accessed vs base objects accessed (#3744) 2021-12-14 18:07:55 -08:00
John Joyce
40963b0635
fix(ingest): remove data platform isalpha check as it complains about s3 (#3742) 2021-12-14 17:39:15 -08:00