5186 Commits

Author SHA1 Message Date
RyanHolstien
34c27f076b
feat(removeGMA): remove all dependencies on gma libraries (#3835) 2022-01-05 17:32:31 -08:00
Ravindra Lanka
9f80e5487d
fix(ingest): metabase - fix the datetime parsing issue (#3831)
fixes #3803
2022-01-05 16:34:05 -08:00
Swaroop Jagadish
480ad24282
feat(ingest): dbt - add support for dbt meta mapping (#3832) 2022-01-05 16:32:05 -08:00
Swaroop Jagadish
daa20f8f38
fix(java-emitter): check for null callback (#3830) 2022-01-05 15:39:07 -08:00
Kevin Hu
5b369447f4
fix(ingest): glue - ignore custom connectors (#3805) 2022-01-05 15:12:50 -08:00
RyanHolstien
9a237e9c92
fix(test): fix bug on verification for EbeanEntityService (#3829)
Co-authored-by: Ryan Holstien <ryan@acryl.io>
2022-01-05 14:05:54 -08:00
abiwill
81f14f9a84
docs: improve docs for kafka configuration (#3828) 2022-01-05 13:31:12 -08:00
Tamas Nemeth
0f20d60bfc
feat(profiler): using approximate queries for profiling (#3752) 2022-01-05 12:42:15 -08:00
Tamas Nemeth
e5d8313788
feat(ingest): sql parsing - Replacing sqlmetadata sql parser lib with sqlineage parser lib (#3806) 2022-01-05 12:22:59 -08:00
Aditya Radhakrishnan
5a0608a7a0
(feat)(glossary): Increase number of autocomplete results shown to 25 (#3821) 2022-01-05 08:14:38 -08:00
Aseem Bansal
6804dab7df
docs(confluent): Add new topic names (#3825) 2022-01-05 08:13:49 -08:00
Dexter Lee
9d04aa1255
feat(mae/mcl): Make ingestAspect produce both MCLs and MAEs (#3737) 2022-01-04 18:24:30 -08:00
Danny L
255462c63c
docs: improve documentation for metadata retention (#3802) 2022-01-04 13:00:39 -08:00
Michael A. Schlosser
101275230e
feat(metadata-service): add Schema Registry support for TLS (#3804)
Co-authored-by: Mike Schlosser <michael.a.schlosser@optum.com>
2022-01-04 12:41:36 -08:00
Tamas Nemeth
286b42663c
fix(ingest): redshift - handle string type for Glue-backed tables (#3811) 2022-01-04 01:43:41 -08:00
Ravindra Lanka
81bc173630
fix(ingest): Make url an optional field of the DefaultConfig for business glossary source. (#3817) 2022-01-04 01:42:01 -08:00
Swaroop Jagadish
3e234a992c
feat(java-emitter): improvements to builder API-s, moving spark-lineage under metadata-integration/java (#3819) 2022-01-04 01:41:09 -08:00
RyanHolstien
40b673403a
docs(fix): fix broken reference (#3814) 2022-01-03 15:15:07 -08:00
Pramod Biligiri
83d6eef35d
docs(modeling): Add a link to MXE page inside the Metadata Modeling page (#3765) 2022-01-03 07:29:15 -08:00
Dexter Lee
76f9423581
feat(nocode): Add get entities v2 endpoint that can get without snapshot (#3738) 2022-01-03 07:19:46 -08:00
Michael A. Schlosser
56ede88d0a
Fix path to elastic definition in dev docker compose (#3808) 2022-01-03 07:01:22 -08:00
MugdhaHardikar-GSLab
c65609a84a
feat(datahub-client): add Java REST emitter (#3781) 2022-01-02 22:48:38 +05:30
Tamas Nemeth
450cdc1739
feat(snowflake-usage): Generate email address if not exists (#3791) 2021-12-29 08:14:18 -08:00
Aseem Bansal
895af09af2
docs(kafka): add example for ingestion from confluent cloud (#3789) v0.8.21 2021-12-28 07:17:03 -08:00
Gabe Lyons
e7b93796b0
fix(elastic): allow more time for re-indexing tasks (#3794) 2021-12-27 10:02:28 -08:00
Tamas Nemeth
5df5150e51
feat(ingest): Add config option to set Bigquery credential in source config (#3786) 2021-12-27 05:48:45 -08:00
Sergio Gómez Villamor
0f8458ad74
doc(transforms): adds doc for simple_add_dataset_properties transformer (#3790) 2021-12-27 05:46:09 -08:00
cccs-eric
2645881b08
fix(superset): fix Superset chart ingestion with an empty metric label (#3792) (#3793) 2021-12-27 05:44:37 -08:00
Tamas Nemeth
c2459056e2
docs(redshift): Updating Redshift permission prerequisites in doc (#3777) 2021-12-22 14:15:09 -08:00
RyanHolstien
d3a441f128
docs(docker): update troubleshooting steps (#3788) 2021-12-22 14:04:54 -08:00
Sergio Gómez Villamor
3fa22e1138
feat(transform): adds simple add dataset properties transform (#3778) 2021-12-22 08:51:38 -08:00
John Joyce
1a65ea76bb
feat(UI): Add "Getting Started" Modal on fresh deployment (#3773) 2021-12-21 19:22:47 -08:00
John Joyce
fa0c15535f
Add azure doc to sidebar (#3785) 2021-12-21 18:34:56 -08:00
cccs-eric
acd930d47e
docs(auth): add Microsoft Azure as an SSO provider (#3779) (#3780) 2021-12-21 18:03:22 -08:00
Gabe Lyons
3860205f00
fix header height (#3784) 2021-12-21 17:59:07 -08:00
Hyun Min Choi
e76d40b57a
fix(lkml): bump lkml version up to 1.1.2 to support sql_preamble expression (#3757) 2021-12-21 12:13:13 -08:00
Aseem Bansal
77e3641a50
fix(ingest): fix compatibility with google composer (#3774) v0.8.20 2021-12-20 12:47:56 -08:00
Tamas Nemeth
2ee1a78f4e
fix(ingestion): Fix for same schema foreign key reference (#3769) 2021-12-20 07:11:55 -08:00
xiphl
8cd1e91072
Upgrade to 3rd Apache patch for log4j (#3772) 2021-12-20 06:55:22 -08:00
John Joyce
110efa68b9
docs(snowflake): Adding documentation about required Snowflake Privileges (#3770) 2021-12-19 12:01:53 -08:00
Aseem Bansal
2770eb6813
docs(ingestion): Add details of sensitive info handling (#3767) 2021-12-19 11:37:32 -08:00
Tamas Nemeth
599edd22ae
fix(ingest): profiling - disable expensive profilers by default (#3759) 2021-12-17 17:17:25 -08:00
John Joyce
926b6eed4e
fix(deps): upgrade to logback 1.2.9 to address CVE-2021-42550 (#3771) 2021-12-17 17:16:11 -08:00
Hyun Min Choi
e73a30dc81
feat(ingest): bigquery - add support for parsing exported audit logs (#3680) 2021-12-17 17:05:21 -08:00
Harshal Sheth
22cef5f897
refactor(test): replace CliRunner with run_datahub_cmd method (#3746) 2021-12-16 20:07:38 -08:00
Ravindra Lanka
bd69e736ba
feat(Stateful Ingestion-2/3): Client side changes for checkpointing a source job state. (#3763)
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
2021-12-16 20:06:33 -08:00
jawadqu
b4eaa9e09e
feat(ingestion): Mode retry wait logic to avoid hitting Mode API rate limit (#3761) 2021-12-16 19:17:12 -08:00
Harshal Sheth
df2cb94ed8
feat(ingest): profiling add upper bound on combined query size (#3762) 2021-12-16 17:34:46 -08:00
MugdhaHardikar-GSLab
e6f8c1c17c
docs(ingest): spark-lineage update artifact name and version (#3760) 2021-12-16 13:55:25 -08:00
Gabi Maeztu
21fbfbba08
doc: Add IOMED as a DataHub adopter (#3758) 2021-12-16 08:49:42 -08:00