3904 Commits

Author SHA1 Message Date
Harshal Sheth
ed360e95c4
fix(ingest/tableau): show warning about token expiry for PATs (#7187) 2023-01-31 10:49:22 -08:00
Patrick Franco Braz
8ee9fa1930
feat(ingest): bigquery - extracts lineage metadata from catalog api (#7137) 2023-01-31 15:02:30 +01:00
Harshal Sheth
db1a0f13f3
fix(ingest): fix issue in glue tests (#7185) 2023-01-30 21:51:21 -08:00
Harshal Sheth
670342ab64
feat(ingest): switch dbt to use auto_stale_entity_removal (#7160) 2023-01-30 19:59:20 -08:00
Mayuri Nehate
efaf092f5b
fix(ingest/GX): fix snowflake urn generated from connection string (#7173)
Co-authored-by: John Joyce <john@acryl.io>
2023-01-30 16:23:42 -08:00
Chris Collins
9978b74cef
fix(docs): Fix broken links in ingestion docs (#7183) 2023-01-30 16:19:31 -08:00
Peter Szalai
8a2230aea4
fix(quickstart): adding back kafka-setup (#7181)
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
2023-01-31 00:34:36 +01:00
Harshal Sheth
b4114c6499
test(ingest/delta-lake): fix spurious directory creation (#7179) 2023-01-30 13:12:18 -08:00
Harshal Sheth
7ace79c153
fix(ingest): switch various sources to auto_stale_entity_removal helper (#7158) 2023-01-30 11:45:12 -08:00
Aseem Bansal
7314aebf71
fix(ingest): azuread group mapping do not stop ingestion (#7169) 2023-01-30 22:27:51 +05:30
mohdsiddique
54562cd2d5
fix(ingestion/powerbi): Not all arguments converted to string (#7157)
Co-authored-by: MohdSiddique Bagwan <mohdsiddique.bagwan@gslab.com>
2023-01-27 18:49:27 +01:00
Harshal Sheth
8c42a1fc2f
fix(ingest/snowflake): fix regression in approx count distinct (#7146) 2023-01-26 16:15:22 -08:00
Harshal Sheth
927d45dda9
feat(ingest): add --log-file option and show CLI logs in UI report (#7118)
Co-authored-by: Tamas Nemeth <treff7es@gmail.com>
2023-01-26 09:25:02 -08:00
Harshal Sheth
ca5c6c3811
fix(ingest): use snowflake median function in profiling (#6987) 2023-01-25 23:56:43 -08:00
Aseem Bansal
91c82fa5db
refactor(cli): extract method, change wording (#7134)
Co-authored-by: John Joyce <john@acryl.io>
2023-01-25 10:54:38 -08:00
Tamas Nemeth
b84e2ac5b2
fix(doc/biquery): Updating bigquery capability doc (#7136) 2023-01-25 17:19:04 +01:00
Shirshanka Das
e842164465
feat(datahub-lite): simplify get response (#7131) 2023-01-25 15:30:55 +01:00
Teppo Naakka
2b43bce3d6
feat(ingest): powerbi # add powerbi workspaces to containers (#6532)
Co-authored-by: John Joyce <john@acryl.io>
2023-01-24 15:06:50 -08:00
Pedro Silva
bef59b0928
feat(quickstart): Remove kafka-setup as a hard deployment requirement (#7073) 2023-01-24 16:12:57 +00:00
Aseem Bansal
ab84863757
fix(ci): do not confirm on force for deletion (#7106) 2023-01-24 17:14:09 +05:30
Mert Tunç
6f5cd3f4a9
feat(redshift): Fetch lineage from unload queries (#7041)
Co-authored-by: Tamas Nemeth <treff7es@gmail.com>
2023-01-24 12:03:17 +01:00
Harshal Sheth
ceaeb42a2b
feat(ingest): hide cartesian product warnings in GE profiler (#7096) 2023-01-24 08:30:50 +01:00
Tamas Nemeth
e92ce161f9
fix(ingest/profile): properly quoting approx_count_distinct (#7101) 2023-01-23 18:07:14 -08:00
Harshal Sheth
45f50d2614
test(ingest): fix kafka admin client mocking (#7098)
Co-authored-by: Tamas Nemeth <treff7es@gmail.com>
2023-01-23 16:22:20 +01:00
Harshal Sheth
54c5017efd
feat(ingest): move datahub-lite to optional dep and add shim when missing (#7097) 2023-01-20 17:24:43 -08:00
Tamas Nemeth
0cdb5e4b4b
refactor(ingest/containers): Refactoring container creation to common place (#6877) 2023-01-21 00:14:31 +01:00
Harshal Sheth
c5747a4cbd
fix(ingest/snowflake): handle corrupted snowflake OCSP cache file (#7095) 2023-01-20 22:40:36 +01:00
J Feldman
84f7f270ac
fix(profiling): Fix syntax for APPROX_COUNT_DISTINCT on bigquery and snowflake (#7087) 2023-01-20 10:21:58 +01:00
Harshal Sheth
13cc16fbc2
fix(cli/lite): fix datahub lite serve command (#7089) 2023-01-20 10:21:24 +01:00
Harshal Sheth
c4f946c609
fix(ingest/bigquery): clear stateful ingestion correctly (#7075)
Co-authored-by: Tamas Nemeth <treff7es@gmail.com>
2023-01-19 18:06:31 +01:00
Shirshanka Das
f31ff9c91e
feat(datahub-lite): adding tab completion, small serialization fixes (#7079) 2023-01-19 11:07:07 +01:00
Shirshanka Das
bdcc356cc5
feat(datahub-lite): introduces a new experimental lightweight impleme… (#7052) 2023-01-18 19:18:56 -08:00
Harshal Sheth
e23eb7108f
feat(ingest): reporting revamp, part 1 (#7031) 2023-01-18 13:34:32 -08:00
Harshal Sheth
d7aa61285b
fix(ingest): support git clone of non-github repos (#7065) 2023-01-18 13:30:24 -08:00
Harshal Sheth
35bd73a28b
feat(ingest): fix handling of unions with aliases in post restli conversion (#7058) 2023-01-18 09:29:46 -08:00
Tim
e2ad881d79
refactor(ingest/athena): Replace s3_staging_dir parameter in Athena source with query_result_location (#7044)
Co-authored-by: John Joyce <john@acryl.io>
2023-01-18 09:25:37 -08:00
Harshal Sheth
fc41f455a0
feat(ingest): support snapshots in dbt and dbt-cloud (#7062)
Co-authored-by: Tamas Nemeth <treff7es@gmail.com>
2023-01-18 08:35:03 -08:00
Mayuri Nehate
4e7faa5503
fix(ingest/tableau): fix node limit exceeded error for workbooks query (#7068) 2023-01-18 14:34:40 +01:00
Harshal Sheth
afaee58ded
fix(ingest): preserve dbt column name casing (#7063) 2023-01-18 11:57:46 +01:00
Harshal Sheth
bc9adfa441
ci(ingest): add flag to skip tests but run codegen during release (#7067) 2023-01-18 11:55:07 +01:00
Harshal Sheth
f39ed5244c
fix(ingest): support multiple entity_registry sections (#7066) 2023-01-18 15:12:08 +05:30
Remi
a3f4c40422
feat(ingestion): pull metabase database, schema names from raw query and api (#7039) 2023-01-17 20:06:55 -08:00
Teppo Naakka
87b3a5d0fc
feat(ingest): extract powerbi endorsements to tags (#6638) 2023-01-17 19:47:15 -08:00
Harshal Sheth
cb12910b6b
feat(ingest): add entity registry in codegen (#6984)
Co-authored-by: Pedro Silva <pedro@acryl.io>
2023-01-17 19:41:43 -08:00
Harshal Sheth
890dae0199
fix(ingest): temporarily disable vertica tests (#7059) 2023-01-17 12:37:16 -08:00
jx2lee
7192f1699d
docs(dbt): fix indentation in dbt meta mapping docs (#7045)
Co-authored-by: jj.lee <jj.lee@coinone.com>
2023-01-17 10:35:04 -08:00
Mayuri Nehate
7607c04ffa
fix(ingest/kafka): fix ResourceType import error for confluent_kafka<1.9.0 (#7046)
Fixes https://github.com/datahub-project/datahub/issues/7020
2023-01-17 10:33:46 -08:00
Rajasekhar-Vuppala
cd9fc26a25
feat(ingest/vertica): Adding Vertica as source in Datahub UI (#7010)
Co-authored-by: Vishal <vishal.k@simplify3x.com>
Co-authored-by: VISHAL KUMAR <110387730+vishalkSimplify@users.noreply.github.com>
Co-authored-by: John Joyce <john@acryl.io>
2023-01-13 13:23:32 -08:00
Tamas Nemeth
b238272dda
fix(ingest/bigquery): Turning some usage warning message to debug log as it caused confusion (#7024) 2023-01-13 12:30:52 -08:00
John Joyce
b8d8d198c5
feat(ingest): Ingest Previews for Looker Charts, Dashboards, and Explores (#6941) 2023-01-13 10:25:48 -08:00