3998 Commits

Author SHA1 Message Date
Harshal Sheth
56618a5e96
feat(ingest): support pydantic v2 in mysql source (#13501) 2025-05-14 09:51:11 -07:00
Harshal Sheth
9a892c6eca
feat(ingest): improve join extraction (#13502) 2025-05-14 09:50:17 -07:00
Michael Minichino
8b4217f7fa
fix(ingest/mode): Additional 404 handling and caching update (#13508) 2025-05-14 09:09:40 -05:00
Jonny Dixon
c756af31b1
feat(ingestion/looker): extract group_labels from looker and add as tags in datahub (#13503) 2025-05-14 13:08:13 +01:00
Michael Minichino
bc860181d8
fix(ingest/mode): Additional pagination and timing metrics (#13497)
Co-authored-by: NehaGslab <neha.marne@gslab.com>
2025-05-13 08:48:38 -05:00
Sergio Gómez Villamor
184fb09fc0
fix(mssql): improve stored proc lineage + add temporary_tables_pattern config (#13415)
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2025-05-13 10:36:52 +02:00
Sergio Gómez Villamor
a03b35e167
chore(hex): debug logs (#13473) 2025-05-13 08:22:12 +02:00
Harshal Sheth
7c791db087
feat(ingest/sql): column logic + join extraction (#13426) 2025-05-12 17:19:44 -07:00
Tamas Nemeth
93c04ad5b4
fix(ingest/presto): Presto/Trino property extraction fix (#13487) 2025-05-12 22:47:56 +02:00
Gabe Lyons
aeda8f4c95
feat(cassandra): Support ssl auth with cassandra (#13465) 2025-05-12 13:15:49 -04:00
Aseem Bansal
01b5cdb541
fix(cli): warn more strongly about hard deletion (#13471) 2025-05-12 15:03:38 +05:30
Harshal Sheth
53af032b6f
fix(sdk): always url-encode entity links (#13483) 2025-05-11 17:36:42 -07:00
Sergio Gómez Villamor
fb7bcbaf17
tests(ingestion): fixes hex and hive docker flakiness (#13476) 2025-05-11 19:06:23 +02:00
Anthony Burdi
f71ff7722a
fix(sdk): use pluralized assertions (#13481) 2025-05-09 16:19:50 -04:00
Tamas Nemeth
60f79153ac
fix(ingest/hive): Fix hive properties with double colon (#13478) 2025-05-09 19:59:40 +02:00
Kevin Karch
4c77c71315
feat(ingest): filter by database in superset and preset (#13409) 2025-05-09 09:51:59 -04:00
Jonny Dixon
ac3ad8bb36
feat(ingestion/kafka): Add optional externalURL base for link to external platform (#12675) 2025-05-09 12:24:24 +01:00
Hyejin Yoon
f6e2f296a0
feat(sdk): update lineage sample script to use client.lineage (#13467) 2025-05-09 12:08:28 +09:00
Hyejin Yoon
a414bbb798
feat(sdk): add datajob lineage & dataset sql parsing lineage (#13365) 2025-05-09 10:20:48 +09:00
Harshal Sheth
926bb3ceba
chore(ingest): bump bounds on cooperative timeout test (#13449) 2025-05-08 12:12:21 +05:30
Tamas Nemeth
f7ea0b9d5d
fix(ingest/mode): Not failing if queries endpoint returns 404 (#13447) 2025-05-07 22:27:15 +02:00
Aseem Bansal
87199ff9d7
fix(ingest/snowflake): parsing issues with empty queries (#13446) 2025-05-07 18:57:04 +05:30
Aseem Bansal
035af5bdf9
fix(cli): ignore extra configs (#13444) 2025-05-07 16:45:25 +05:30
Tamas Nemeth
c3852dada5
fix(ingest/tableau): Fix infinite loop in Tableau retry (#13442) 2025-05-07 12:16:55 +02:00
Tamas Nemeth
2f44cc74a9
fix(docker): Fix for metadata ingestion docker build (#13435) 2025-05-06 23:07:47 +02:00
Harshal Sheth
287f373a9c
fix(ingest/snowflake): fix previously broken tests (#13428) 2025-05-06 10:19:25 -07:00
Anthony Burdi
294ad23500
feat(sdk): scaffold assertion client (#13362)
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2025-05-06 10:51:34 -04:00
skrydal
65d1c2b43c
feat(ingestion): Make jsonProps of schemaMetadata less verbose (#13416) 2025-05-06 16:18:26 +02:00
Harshal Sheth
cb3988a5f3
feat(ingest): associate queries with operations (#13404) 2025-05-05 11:27:33 -07:00
Harshal Sheth
2e3328fce0
chore(ingest): bump sqlglot dep (#13411) 2025-05-05 09:24:50 -07:00
david-leifker
4e7bb3998d
feat(ingestion): refactor api-tracing EmitMode (#13397) 2025-05-05 10:54:31 -05:00
Harshal Sheth
f83460255a
feat(ingest): add urn -> url helpers (#13410) 2025-05-02 19:54:01 -07:00
Harshal Sheth
096e6d9af4
chore(ingest/snowflake): clean up unused params in Snowflake connections (#13379) 2025-05-02 13:05:12 -07:00
Harshal Sheth
e2844b6c95
fix(ingest): move to acryl-great-expectations (#13398) 2025-05-02 13:04:53 -07:00
Harshal Sheth
b7ef234bc7
fix(ingest): fix deps for fivetran (#13385) 2025-05-02 12:31:07 -07:00
Aseem Bansal
03531520ce
fix(ingest/dynamodb): put primary keys correctly (#13373) 2025-05-02 15:25:34 +05:30
Aseem Bansal
42aeed074f
chore: upgrade dev dependencies mypy and ruff (#13375) 2025-05-02 15:02:00 +05:30
Aseem Bansal
7f681ee339
docs(dynamodb): add privileges for dynamodb (#13372) 2025-05-02 12:24:03 +05:30
David Leifker
e6babc3b81 Revert "feat(ingestion): refactor api-tracing EmitMode"
This reverts commit bf598aed9687e9b08ccfbd72257fc890b505d775.
2025-05-01 21:06:10 -05:00
David Leifker
bf598aed96 feat(ingestion): refactor api-tracing EmitMode
* Created EmitMode to control write guarantees
    * IMMEDIATE, QUEUE, BLOCKING_QUEUE
2025-05-01 20:30:21 -05:00
Esteban Gutierrez
9b6960ac8e
feat(azure): include azure-identity-extensions for Microsoft Entra Workload Identity connections (#13395) 2025-05-01 20:22:47 -05:00
david-leifker
8919154f02
fix(ingestion): fix cloud vs core logic (#13387) 2025-05-01 16:16:41 -05:00
Harshal Sheth
bb9838d789
fix(ingest): use server config method from graph (#13391) 2025-05-01 12:32:56 -07:00
Harshal Sheth
591b6ce0c9
feat(actions): support pydantic v2 (#13378) 2025-04-30 19:39:35 -07:00
david-leifker
d25d318233
feat(ingestion-sdk): OpenAPI & Tracing With SDK (#13349)
Co-authored-by: Andrew Sikowitz <andrew.sikowitz@acryl.io>
2025-04-30 21:09:12 -05:00
Harshal Sheth
34e74d826e
fix(ingest): update dremio golden files (#13381) 2025-04-30 17:45:54 -05:00
Harshal Sheth
d264a7afba
feat(ingest/dbt): make catalog.json optional (#13352) 2025-04-29 10:39:53 -07:00
Hyejin Yoon
f986315582
doc: Acryl to DataHub, datahubproject.io to datahub.com (#13252)
Co-authored-by: Jay <159848059+jayacryl@users.noreply.github.com>
2025-04-28 10:34:33 -04:00
Sergio Gómez Villamor
312e1ff573
chore(looker): reduce verbosity if error during initialization (#13331) 2025-04-28 13:11:58 +02:00
Sergio Gómez Villamor
e143422d2d
feat(dbt): log catalog and manifest metadata (#13329) 2025-04-28 10:19:03 +02:00