959 Commits

Author SHA1 Message Date
Michael Minichino
8af66d6f39 Merge branch 'master' into mm--excel-file-source 2025-05-27 16:51:22 -05:00
Andrew R Smith
647fb792de
feat(ingest): add snowflake ingestion config options (#12841)
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2025-05-27 09:22:16 -07:00
Sergio Gómez Villamor
d8d1de431f
fix(iceberg): update MinIO client commands for compatibility (#13631)
Co-authored-by: Claude <noreply@anthropic.com>
2025-05-27 11:15:41 +02:00
Michael Minichino
fca8e8fd3a feat(ingest/excel): Update mce_helpers import 2025-05-21 11:27:34 -05:00
Michael Minichino
82bd202e7d Merge branch 'master' into mm--excel-file-source 2025-05-20 14:37:25 -05:00
Tamas Nemeth
0eca4dfde2
fix(ingest/hive): Fix hive storage path formats (#13536) 2025-05-19 16:17:28 +02:00
Sergio Gómez Villamor
8cae980286
tests(ingestion): moving some tests so they are available for sdk users (#13540) 2025-05-19 08:39:53 +02:00
Jonny Dixon
132ff7081f
feat(ingestion/s3): Add externalUrls for datasets in s3 and gcs (#12763) 2025-05-17 17:03:40 +01:00
Harshal Sheth
d3944ded93
feat(ingest/snowflake): generate lineage through temp views (#13517) 2025-05-16 21:27:13 -07:00
Jonny Dixon
c756af31b1
feat(ingestion/looker): extract group_labels from looker and add as tags in datahub (#13503) 2025-05-14 13:08:13 +01:00
Michael Minichino
bc860181d8
fix(ingest/mode): Additional pagination and timing metrics (#13497)
Co-authored-by: NehaGslab <neha.marne@gslab.com>
2025-05-13 08:48:38 -05:00
Sergio Gómez Villamor
184fb09fc0
fix(mssql): improve stored proc lineage + add temporary_tables_pattern config (#13415)
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2025-05-13 10:36:52 +02:00
Harshal Sheth
7c791db087
feat(ingest/sql): column logic + join extraction (#13426) 2025-05-12 17:19:44 -07:00
Sergio Gómez Villamor
fb7bcbaf17
tests(ingestion): fixes hex and hive docker flakiness (#13476) 2025-05-11 19:06:23 +02:00
Tamas Nemeth
60f79153ac
fix(ingest/hive): Fix hive properties with double colon (#13478) 2025-05-09 19:59:40 +02:00
Michael Minichino
6cc63b1031 Merge branch 'master' into mm--excel-file-source 2025-05-06 18:51:34 -05:00
Michael Minichino
9a24405a2d feat(ingest/excel): Add Excel Source 2025-05-06 18:50:38 -05:00
Harshal Sheth
287f373a9c
fix(ingest/snowflake): fix previously broken tests (#13428) 2025-05-06 10:19:25 -07:00
skrydal
65d1c2b43c
feat(ingestion): Make jsonProps of schemaMetadata less verbose (#13416) 2025-05-06 16:18:26 +02:00
Michael Minichino
1952ea40e2 Merge branch 'master' into mm--excel-file-source 2025-05-05 15:32:25 -05:00
Michael Minichino
03850868f1 feat(ingest/excel): Add Excel Source 2025-05-05 15:31:44 -05:00
Harshal Sheth
cb3988a5f3
feat(ingest): associate queries with operations (#13404) 2025-05-05 11:27:33 -07:00
Aseem Bansal
03531520ce
fix(ingest/dynamodb): put primary keys correctly (#13373) 2025-05-02 15:25:34 +05:30
Harshal Sheth
34e74d826e
fix(ingest): update dremio golden files (#13381) 2025-04-30 17:45:54 -05:00
Hyejin Yoon
f986315582
doc: Acryl to DataHub, datahubproject.io to datahub.com (#13252)
Co-authored-by: Jay <159848059+jayacryl@users.noreply.github.com>
2025-04-28 10:34:33 -04:00
Michael Minichino
fee67788a3
fix(ingest/mode): Add pagination and warn on missing reports (#13322) 2025-04-25 18:21:27 -05:00
Sergio Gómez Villamor
a8637abfe2
tests(kafka): fixing flaky tests (#13171) 2025-04-22 12:58:47 +02:00
Michael Minichino
bd890eeb62 feat(ingest/excel): Add Excel Source 2025-04-21 20:09:43 -05:00
Harshal Sheth
f48c6b53ee
feat(ingest/snowflake): show returned query row counts (#13246) 2025-04-21 14:41:40 -07:00
Chakru
54156ea78a
fix(cli): use patch to update dataset properties (#13226) 2025-04-21 14:41:31 -07:00
Michael Minichino
d60b39c820 Merge branch 'master' into mm--excel-file-source 2025-04-21 15:07:14 -05:00
Harshal Sheth
08453cfbb1
fix(ingest/hive): support multiline view definitions (#13248) 2025-04-21 11:11:35 -07:00
Harshal Sheth
9f7f3cb886
chore(ingest/snowflake): remove unused query code (#13245) 2025-04-21 10:31:36 -07:00
Harshal Sheth
5ba8b7d173
fix(ingest/fivetran): use project id by default for bigquery (#13250) 2025-04-20 21:39:40 -07:00
Michael Minichino
871776c2d1 feat(ingest/excel): Add Excel Source 2025-04-19 15:32:07 -05:00
Michael Minichino
52863176f6 feat(ingest/excel): Add Excel Source 2025-04-19 15:11:49 -05:00
Michael Minichino
02491c4556 feat(ingest/excel): Add Excel Source 2025-04-18 16:31:15 -05:00
Michael Minichino
3dad9449bf Merge branch 'master' into mm--excel-file-source 2025-04-18 15:52:00 -05:00
Michael Minichino
190c46efc7 Merge branch 'master' into mm--excel-file-source 2025-04-18 15:36:29 -05:00
Michael Minichino
fcc6f25e30 feat(ingest/excel): Add Excel Source 2025-04-17 19:22:13 -05:00
skrydal
47490ec050
feat(ingestion/iceberg): Add capability to extract namespace properties to the iceberg ingestor (#13238) 2025-04-17 16:29:43 +02:00
Hyejin Yoon
72aab9fe63
feat(sdk): add sdk lineage client (#13244)
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2025-04-17 17:44:07 +09:00
Sergio Gómez Villamor
f3dfd86680
fix(looker): missing Looker Explore relationship when Look references multiple models (#13198) 2025-04-17 07:53:13 +02:00
Andrew Sikowitz
d138a64a6a
ci(graphql,workflows): Format .md, .graphql, and workflow .yml files via prettier (#13220) 2025-04-16 16:55:51 -07:00
Andrew Sikowitz
3e37f76428
feat(ingest/tableau): Allow specifying asset types for ingest_hidden_assets (#13190) 2025-04-11 20:07:37 -07:00
ryota-cloud
ca4eab52e4
VertexAI Connector (v3 - pipeline and pipeline task) (#12960) 2025-04-10 22:54:17 -07:00
Andrew Sikowitz
ca51df880f
fix(ingest/snowflake): Use CREATE change type when creating structured properties; support MCP headers (#13158) 2025-04-10 15:13:13 -05:00
Michael Minichino
0b105395e9
feat(ingest/powerbi): Support ODBC Data Source (#13090) 2025-04-10 08:57:37 -05:00
Sergio Gómez Villamor
4e48e098dc
fix(ingestion): fixes missing platform instance aspect for DataFlow entitiy (#13080) 2025-04-06 08:19:47 +02:00
Sergio Gómez Villamor
b37fa03846
chore: fixes SIM118 ruff rule (#13069) 2025-04-04 11:59:43 +02:00