3975 Commits

Author SHA1 Message Date
Connell Donaghy
07e1c2d6b3
fix(cli): safely initialize schema_fields (#13586) 2025-06-03 15:16:27 +02:00
Atanu Chatterjee
487d52ad6e
fix(openapi_parser): add ability to parse openapi 3.0+ schemas (#13624) 2025-06-01 18:52:52 +02:00
Aseem Bansal
acb7210040
fix(log): improve log for list-source-runs without privileges (#13653) 2025-05-30 15:06:26 +05:30
Hyejin Yoon
a142a9e2d2
feat(sdk): add dataflow and datajob entity (#13551) 2025-05-29 22:53:56 +09:00
Sergio Gómez Villamor
fea6e6ac4f
fix(snowflake): pass correct BaseTimeWindowConfig instead of SnowflakeV2Config (#13643)
Co-authored-by: Claude <noreply@anthropic.com>
2025-05-28 13:08:43 +02:00
Sergio Gómez Villamor
f2ca93d275
feat(openapi): add verify_ssl configuration option (#13634)
Co-authored-by: Claude <noreply@anthropic.com>
2025-05-28 09:35:45 +02:00
david-leifker
492b55322f
feat(tracing): trace error log with timestamp & update system-metadata (#13628) 2025-05-27 17:33:40 -05:00
Andrew R Smith
647fb792de
feat(ingest): add snowflake ingestion config options (#12841)
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2025-05-27 09:22:16 -07:00
Sergio Gómez Villamor
d8d1de431f
fix(iceberg): update MinIO client commands for compatibility (#13631)
Co-authored-by: Claude <noreply@anthropic.com>
2025-05-27 11:15:41 +02:00
David Leifker
b956132e3c Revert "feat(tracing): python logging & update system metadata on no-op"
This reverts commit 64f315eb64417467cfef5cec473068dc42886293.
2025-05-26 12:15:18 -05:00
David Leifker
64f315eb64 feat(tracing): python logging & update system metadata on no-op 2025-05-26 10:22:51 -05:00
Tamas Nemeth
2ffa84be5c
fix(ingest/datahub): Create Structured property templates in advance and batch processing (#13355)
Co-authored-by: Pedro Silva <pedro@acryl.io>
2025-05-26 14:05:17 +02:00
Sergio Gómez Villamor
7bd7a33d0b
feat(hex): consider additional context when parsing hex query metadata (#13596) 2025-05-23 08:01:04 +02:00
Harshal Sheth
69f368b00e
fix(ingest): restrict duckdb dep on old python versions (#13605) 2025-05-22 16:19:31 -07:00
Harshal Sheth
7e60587dec
fix(cli): strictly validate structured property values (#13576)
Co-authored-by: Chakravarthy Racharla <chakru.racharla@acryl.io>
2025-05-21 08:36:50 -07:00
Tamas Nemeth
9fca1737ff
fix(ingest/dbt): Fix urn validation in ownership type check (#13563) 2025-05-21 13:02:26 +02:00
Harshal Sheth
e37b3c3394
feat(ingest/dbt): fallback to schema from graph (#13438) 2025-05-20 10:20:50 -07:00
Tamas Nemeth
0eca4dfde2
fix(ingest/hive): Fix hive storage path formats (#13536) 2025-05-19 16:17:28 +02:00
Jonny Dixon
9584006a72
fix(ingestion/datahubapply): fix typos in config descriptions (#13546) 2025-05-19 11:25:25 +01:00
Sergio Gómez Villamor
8cae980286
tests(ingestion): moving some tests so they are available for sdk users (#13540) 2025-05-19 08:39:53 +02:00
Jonny Dixon
132ff7081f
feat(ingestion/s3): Add externalUrls for datasets in s3 and gcs (#12763) 2025-05-17 17:03:40 +01:00
Harshal Sheth
d3944ded93
feat(ingest/snowflake): generate lineage through temp views (#13517) 2025-05-16 21:27:13 -07:00
John Joyce
c9e6831f08
fea(ui): Add menu action for copying the full name of the asset (#13224)
Co-authored-by: John Joyce <john@Mac-2465.lan>
Co-authored-by: John Joyce <john@Mac-1293.lan>
2025-05-15 13:50:31 -07:00
Kevin Karch
e47606d21c
fix(docs): update support limits for liquid-python (#13524) 2025-05-15 11:59:58 -04:00
Aseem Bansal
401214fa5d
fix(cli): move to stderr instead of stdout (#13512)
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2025-05-15 13:35:56 +05:30
Aseem Bansal
199144167a
fix(sdk): change deprecated value use (#13511) 2025-05-15 13:35:34 +05:30
Harshal Sheth
1c7836dce8
fix(cli): avoid click 8.2.0 due to bugs (#13518) 2025-05-14 23:26:18 -07:00
Harshal Sheth
56618a5e96
feat(ingest): support pydantic v2 in mysql source (#13501) 2025-05-14 09:51:11 -07:00
Harshal Sheth
9a892c6eca
feat(ingest): improve join extraction (#13502) 2025-05-14 09:50:17 -07:00
Michael Minichino
8b4217f7fa
fix(ingest/mode): Additional 404 handling and caching update (#13508) 2025-05-14 09:09:40 -05:00
Jonny Dixon
c756af31b1
feat(ingestion/looker): extract group_labels from looker and add as tags in datahub (#13503) 2025-05-14 13:08:13 +01:00
Michael Minichino
bc860181d8
fix(ingest/mode): Additional pagination and timing metrics (#13497)
Co-authored-by: NehaGslab <neha.marne@gslab.com>
2025-05-13 08:48:38 -05:00
Sergio Gómez Villamor
184fb09fc0
fix(mssql): improve stored proc lineage + add temporary_tables_pattern config (#13415)
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2025-05-13 10:36:52 +02:00
Sergio Gómez Villamor
a03b35e167
chore(hex): debug logs (#13473) 2025-05-13 08:22:12 +02:00
Harshal Sheth
7c791db087
feat(ingest/sql): column logic + join extraction (#13426) 2025-05-12 17:19:44 -07:00
Tamas Nemeth
93c04ad5b4
fix(ingest/presto): Presto/Trino property extraction fix (#13487) 2025-05-12 22:47:56 +02:00
Gabe Lyons
aeda8f4c95
feat(cassandra): Support ssl auth with cassandra (#13465) 2025-05-12 13:15:49 -04:00
Aseem Bansal
01b5cdb541
fix(cli): warn more strongly about hard deletion (#13471) 2025-05-12 15:03:38 +05:30
Harshal Sheth
53af032b6f
fix(sdk): always url-encode entity links (#13483) 2025-05-11 17:36:42 -07:00
Sergio Gómez Villamor
fb7bcbaf17
tests(ingestion): fixes hex and hive docker flakiness (#13476) 2025-05-11 19:06:23 +02:00
Anthony Burdi
f71ff7722a
fix(sdk): use pluralized assertions (#13481) 2025-05-09 16:19:50 -04:00
Tamas Nemeth
60f79153ac
fix(ingest/hive): Fix hive properties with double colon (#13478) 2025-05-09 19:59:40 +02:00
Kevin Karch
4c77c71315
feat(ingest): filter by database in superset and preset (#13409) 2025-05-09 09:51:59 -04:00
Jonny Dixon
ac3ad8bb36
feat(ingestion/kafka): Add optional externalURL base for link to external platform (#12675) 2025-05-09 12:24:24 +01:00
Hyejin Yoon
f6e2f296a0
feat(sdk): update lineage sample script to use client.lineage (#13467) 2025-05-09 12:08:28 +09:00
Hyejin Yoon
a414bbb798
feat(sdk): add datajob lineage & dataset sql parsing lineage (#13365) 2025-05-09 10:20:48 +09:00
Harshal Sheth
926bb3ceba
chore(ingest): bump bounds on cooperative timeout test (#13449) 2025-05-08 12:12:21 +05:30
Tamas Nemeth
f7ea0b9d5d
fix(ingest/mode): Not failing if queries endpoint returns 404 (#13447) 2025-05-07 22:27:15 +02:00
Aseem Bansal
87199ff9d7
fix(ingest/snowflake): parsing issues with empty queries (#13446) 2025-05-07 18:57:04 +05:30
Aseem Bansal
035af5bdf9
fix(cli): ignore extra configs (#13444) 2025-05-07 16:45:25 +05:30