4067 Commits

Author SHA1 Message Date
Jonny Dixon
29bee48a93 revert to standard constants 2025-06-11 21:31:21 +01:00
Jonny Dixon
3ec67f7dca Revert "cll for datasets"
This reverts commit 9d625d21efecf78cdd5dc35731c3e00cef7dc6e7.
2025-06-11 21:22:49 +01:00
Jonny Dixon
9d625d21ef cll for datasets 2025-06-11 16:17:09 +01:00
Jonny Dixon
e7bb418988 fix bug 2025-06-11 14:59:09 +01:00
Jonny Dixon
e1f26096d3 use FIVETRAN_PLATFORM_TO_DATAHUB_PLATFORM in lookup 2025-06-11 13:57:13 +01:00
Jonny Dixon
b314cd7076 Aurora mapping to MySQL 2025-06-11 13:31:33 +01:00
Jonny Dixon
fe39c27227 Revert "retrieve database"
This reverts commit 21c4903e55f52f7539d1fc878f7ac9f038996b69.
2025-06-11 13:22:57 +01:00
Jonny Dixon
dfb869b3e0 Revert "retrieve database"
This reverts commit 21c4903e55f52f7539d1fc878f7ac9f038996b69.
2025-06-11 13:14:17 +01:00
Jonny Dixon
3ba3cff90e
Merge branch 'master' into fivetran-std-edition-support 2025-06-11 12:13:12 +01:00
Jonny Dixon
21c4903e55 retrieve database 2025-06-11 12:12:45 +01:00
Jonny Dixon
12ca57c818 remove parallel processing 2025-06-11 11:43:09 +01:00
Tamas Nemeth
6b8dfb0aa8
feat(ingest/glue): Lake formation tags ingestion (#13693) 2025-06-11 12:26:27 +02:00
Jonny Dixon
96f27a1f65 updates for mysql and mssql 2025-06-11 09:18:42 +01:00
Jonny Dixon
f908af9f41
Merge branch 'master' into fivetran-std-edition-support 2025-06-11 08:49:18 +01:00
david-leifker
794a2ab317
feat(config): update configuration caching (#13740) 2025-06-10 15:17:05 -05:00
Anthony Burdi
eba14287bb
refactor(sdk): Use sdk instead of _sdk_extras (#13736) 2025-06-10 14:10:57 -04:00
Harshal Sheth
78cfc49703
chore(ingest): bump sqlglot dep (#13730) 2025-06-10 11:09:37 -07:00
Jonny Dixon
0fa88189c8
feat(ingestion/mssql): detection of rds or managed sql server for jobs history (#13731) 2025-06-10 18:41:26 +01:00
david-leifker
4f5e9c7508
feat(rest-emitter): set 60s ttl on gms config cache (#13729) 2025-06-10 09:21:29 -05:00
Anthony Burdi
1dc3a19145
feat(sdk): Add subscriptions client to main client OSS (#13713) 2025-06-09 11:29:15 -04:00
Anthony Burdi
79e8da01e2
fix(sdk): Ignore mypy error for conditional ResolverClient import (#13712) 2025-06-06 18:01:02 -04:00
Anthony Burdi
92af5546b6
feat(sdk): Add support for Assertion and Monitor entities (#13699) 2025-06-06 09:38:11 -04:00
Tamas Nemeth
0eef7a02c7
feat(ingest/unity-catalog): Tag extraction (#13642) 2025-06-06 13:24:56 +02:00
Hyejin Yoon
e82cc6672b
feat(sdk) add dashboard & chart entity (#13669) 2025-06-06 16:28:28 +09:00
Hyejin Yoon
e169b4ac05
feat(sdk): add get_lineage (#13654) 2025-06-06 12:34:52 +09:00
Sergio Gómez Villamor
67844f1a53
feat(sdk): add EntityClient.delete documentation and tests (#13688) 2025-06-05 14:46:14 +02:00
Hyejin Yoon
83881e4129
feat(sdk): add add_lineage to lineage subclient (#13622) 2025-06-05 15:26:53 +09:00
Hyejin Yoon
488f011fa0
feat(sdk): add structured properties aspect (#13689) 2025-06-05 14:24:22 +09:00
david-leifker
799a9f2e31
feat(search): lineage search performance (#13545) 2025-06-04 13:54:45 -05:00
Jonny Dixon
612f68eced
feat(ingestion/sql-common): add column level lineage for external tables (#11997) 2025-06-04 13:24:44 +01:00
Connell Donaghy
07e1c2d6b3
fix(cli): safely initialize schema_fields (#13586) 2025-06-03 15:16:27 +02:00
Atanu Chatterjee
487d52ad6e
fix(openapi_parser): add ability to parse openapi 3.0+ schemas (#13624) 2025-06-01 18:52:52 +02:00
Aseem Bansal
acb7210040
fix(log): improve log for list-source-runs without privileges (#13653) 2025-05-30 15:06:26 +05:30
Hyejin Yoon
a142a9e2d2
feat(sdk): add dataflow and datajob entity (#13551) 2025-05-29 22:53:56 +09:00
Sergio Gómez Villamor
fea6e6ac4f
fix(snowflake): pass correct BaseTimeWindowConfig instead of SnowflakeV2Config (#13643)
Co-authored-by: Claude <noreply@anthropic.com>
2025-05-28 13:08:43 +02:00
Sergio Gómez Villamor
f2ca93d275
feat(openapi): add verify_ssl configuration option (#13634)
Co-authored-by: Claude <noreply@anthropic.com>
2025-05-28 09:35:45 +02:00
david-leifker
492b55322f
feat(tracing): trace error log with timestamp & update system-metadata (#13628) 2025-05-27 17:33:40 -05:00
Andrew R Smith
647fb792de
feat(ingest): add snowflake ingestion config options (#12841)
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2025-05-27 09:22:16 -07:00
Sergio Gómez Villamor
d8d1de431f
fix(iceberg): update MinIO client commands for compatibility (#13631)
Co-authored-by: Claude <noreply@anthropic.com>
2025-05-27 11:15:41 +02:00
David Leifker
b956132e3c Revert "feat(tracing): python logging & update system metadata on no-op"
This reverts commit 64f315eb64417467cfef5cec473068dc42886293.
2025-05-26 12:15:18 -05:00
David Leifker
64f315eb64 feat(tracing): python logging & update system metadata on no-op 2025-05-26 10:22:51 -05:00
Tamas Nemeth
2ffa84be5c
fix(ingest/datahub): Create Structured property templates in advance and batch processing (#13355)
Co-authored-by: Pedro Silva <pedro@acryl.io>
2025-05-26 14:05:17 +02:00
Jonny Dixon
6cec789481
Merge branch 'master' into fivetran-std-edition-support 2025-05-24 01:42:48 +01:00
Sergio Gómez Villamor
7bd7a33d0b
feat(hex): consider additional context when parsing hex query metadata (#13596) 2025-05-23 08:01:04 +02:00
Harshal Sheth
69f368b00e
fix(ingest): restrict duckdb dep on old python versions (#13605) 2025-05-22 16:19:31 -07:00
Harshal Sheth
7e60587dec
fix(cli): strictly validate structured property values (#13576)
Co-authored-by: Chakravarthy Racharla <chakru.racharla@acryl.io>
2025-05-21 08:36:50 -07:00
Tamas Nemeth
9fca1737ff
fix(ingest/dbt): Fix urn validation in ownership type check (#13563) 2025-05-21 13:02:26 +02:00
Harshal Sheth
e37b3c3394
feat(ingest/dbt): fallback to schema from graph (#13438) 2025-05-20 10:20:50 -07:00
Tamas Nemeth
0eca4dfde2
fix(ingest/hive): Fix hive storage path formats (#13536) 2025-05-19 16:17:28 +02:00
Jonny Dixon
9584006a72
fix(ingestion/datahubapply): fix typos in config descriptions (#13546) 2025-05-19 11:25:25 +01:00