1020 Commits

Author SHA1 Message Date
Anush Kumar
bf09c5eebf
fix(ingestion): updated json_extract function for postgres db #12604 (#14533) 2025-08-21 15:42:51 -07:00
Benjamin Maquet
952807eb13
fix(cli): skip version warning message for servers (#14470) 2025-08-19 21:07:46 +05:30
Aseem Bansal
9a741dc92f
fix(ingest): exclude soft deleted entities from counts (#14490) 2025-08-19 17:10:53 +05:30
Sergio Gómez Villamor
22bce85410
feat(snowflake): enhance pushdown_deny_usernames by allowing patterns and add pushdown_allow_usernames (#14428) 2025-08-13 11:58:23 +02:00
Michael Maltese
738f16ce91
fix(ingest/hex): use viewer external URL for published projects/components (#14353) 2025-08-12 12:43:19 -04:00
Tamas Nemeth
6fa4f3e590
fix(ingest/unity): Add option to set databricks api page size (#14430) 2025-08-12 13:38:32 +02:00
Benjamin Maquet
48f5ba466d
feat(superset/preset): add column-level-lineage support for aggregate charts (#14242)
Thanks for the contribution!
2025-08-12 09:17:10 +02:00
Tamas Nemeth
f1e7ce72f0
fix(ingest/looker): Ignore fields with empty column name to not generate invalid field urns (#14338) 2025-08-12 08:55:14 +02:00
Tamas Nemeth
6787d83fa6
fix(ingest/unity-catalog): Speed up tag extraction by caching platform resources (#14376)
The pr reworks the external entity api for platform resources
2025-08-11 22:51:25 +02:00
Jonny Dixon
c12e4b27e7
feat(ingestion/snowflake): formal support of dynamic tables (#13542) 2025-08-11 19:17:27 +01:00
Aseem Bansal
26b0d51854
fix(ingest): separate out existence dict and full count dict (#14396) 2025-08-08 18:37:24 +05:30
Benjamin Maquet
ed3cfc5d42
fix(ingest/dbt-cloud): use correct node description for sources (#14321) 2025-08-07 13:53:04 -07:00
Andrew Sikowitz
bd2198fcdc
feat(sdk/patch): Support DataJob fine grained lineage patch (#14377) 2025-08-07 13:07:38 -07:00
Tamas Nemeth
154c065aa8
feat(ingest/sdkv2): Add skip cache parameter to urn search (#14369) 2025-08-07 18:22:08 +02:00
Tamas Nemeth
ea091bb9cc
feat(ingest/unity): Get table lineage from system table (#14282) 2025-08-06 21:11:43 +02:00
Tamas Nemeth
560b5ec54e
fix(ingest/glue): Add fix for empty script path in glue (#14324) 2025-08-06 09:27:34 +02:00
Tamas Nemeth
86ffe5223d
feat(ingest/sdkv2): Add way to pass in emit_mode to entity client update and upsert (#14336)
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2025-08-06 08:40:23 +02:00
Tamas Nemeth
8845cf27f8
fix(ingest/api): External tag (UnityTag, LakeFormationTag) fixes (#14322) 2025-08-05 10:08:45 -07:00
Aseem Bansal
da0cb6d093
test(cli/upgrade): add unit test for check upgrade (#14313) 2025-08-05 14:52:01 +05:30
Gabe Lyons
3abeadde4e
feat(meta-mappping): support meta mappings of lists (#14306) 2025-08-01 12:26:45 -07:00
Harshal Sheth
fe3ffc1c27
revert(ingest): Extending file sink to support writing to S3 (#14160) (#14248) 2025-07-29 12:13:26 +02:00
John Joyce
9ff5a2cf9d
feat(ingest): Extending file sink to support writing to S3 (#14160)
Co-authored-by: John Joyce <john@Mac-2290.lan>
Co-authored-by: John Joyce <john@Mac-2536.lan>
2025-07-28 09:18:44 -07:00
Sergio Gómez Villamor
7a27e8e7fd
fix(ingest/sql-queries): handle string timestamps and empty table names (#14205)
Co-authored-by: Claude <noreply@anthropic.com>
2025-07-25 22:33:49 +02:00
Harshal Sheth
9490eba8dc
fix(sdk): make Filter type parsing more permissive (#14212) 2025-07-25 09:37:23 -07:00
Sergio Gómez Villamor
e24fc39966
feat(sql-parsing-aggregator): add override_dialect for observed query (#14201) 2025-07-25 08:21:44 +02:00
mihai103
8e1fbaffad
Adding support for domains when upserting datasets with the cli (#14152)
Co-authored-by: Mihai Ciocirdel <mihai.ciocirdel@swisscom.com>
Co-authored-by: Hyejin Yoon <0327jane@gmail.com>
2025-07-24 17:35:17 -04:00
Harshal Sheth
446f31f1bd
feat(sdk): expose view definition in dataset sdk (#14197) 2025-07-24 10:14:30 -07:00
Jonny Dixon
836e301e3b
feat(ingestion/grafana): Add datasets and charts to dashboards with lineage and tags. Lineage back to source (#12417)
Co-authored-by: Sergio Gómez Villamor <sgomezvillamor@gmail.com>
2025-07-24 17:05:09 +01:00
Harshal Sheth
658930e887
feat(ingest/dbt): add drop_duplicate_sources flag (#14161) 2025-07-23 22:05:35 -07:00
Jonny Dixon
a679ffca73
fix(ingestion/abs): align add_partition_columns_to_schema functionality with working s3/gcs functionality in abs connector (#14153) 2025-07-22 18:36:17 +01:00
Harshal Sheth
648983a710
feat(sdk): add data products to suggested entity type filters (#14159) 2025-07-22 08:23:59 -07:00
Harshal Sheth
1d65c454df
feat(sdk): add container filter to search sdk (#14130) 2025-07-21 12:05:51 -07:00
Harshal Sheth
c92aa0842e
feat(sdk): use discriminated unions for Filter types (#14127) 2025-07-21 08:23:07 -07:00
Aseem Bansal
14e7d367e3
feat(ingest/mock-data): misc changes (#14133) 2025-07-18 14:20:23 +05:30
Aseem Bansal
9e57fa7f9f
feat(mock-data): allow throwing uncaught exception, errors, warning (#14105) 2025-07-17 14:42:58 +05:30
Tamas Nemeth
d63a35ab00
fix(ingest/athena): Make Athena simple column v1 conversion optional (#14112)
Co-authored-by: Sergio Gómez Villamor <sgomezvillamor@gmail.com>
2025-07-17 09:15:48 +02:00
Jonny Dixon
010da3c480
fix(ingestion/abs): updated deprecated azure sdk parameter to supported parameter and uri prefix support of https (#14106) 2025-07-16 18:44:31 +01:00
Sergio Gómez Villamor
6c82d70642
fix(snowflake): correct additional_database_names OR logic in access_history filter (#14104)
Co-authored-by: Claude <noreply@anthropic.com>
2025-07-16 12:10:12 +02:00
Chakru
3ab354eac4
fix(quickstart): update commit hash with resolved quickstart profile (#14089) 2025-07-15 22:19:29 +05:30
Sergio Gómez Villamor
7c8c55bc4e
feat(snowflake): add database pattern filtering to access history query for improved performance (#14021)
Co-authored-by: Claude <noreply@anthropic.com>
2025-07-14 18:15:13 +02:00
Aseem Bansal
8d332b68b8
fix(ingest): better experimental contract (#14071) 2025-07-14 19:45:55 +05:30
Aseem Bansal
9e205ccc53
fix(ingest/report): fix bug w.r.t. aspect count (#14070) 2025-07-14 16:17:16 +05:30
RyanHolstien
c694168991
feat(rest_emitter): support delete emit mcp (#14033) 2025-07-11 15:41:42 -05:00
Harshal Sheth
84ad365b37
chore(ingest/teradata): fix lint errors (#14055) 2025-07-11 13:01:10 -07:00
Harshal Sheth
47d40dc1fd
fix(sdk): deduplicate entity types in search sdk (#14041) 2025-07-11 11:42:33 -07:00
Tamas Nemeth
3c748c1b3c
fix(ingest/teradata): Teradata perf improvements (#13967) 2025-07-11 17:47:11 +02:00
Chakru
21726bc334
feat(quickstart): migrate to compose profile and other improv. (#13566) 2025-07-11 20:12:10 +05:30
skrydal
c0d651362b
feat(ingestion): Introduce query dedup strategy (#13915) 2025-07-11 15:51:41 +02:00
skrydal
f0a6e016e8
fix(ingestion/snowflake): Address diamond lineage problem + performance improvements (#13918) 2025-07-11 15:50:52 +02:00
Harshal Sheth
8758e85739
refactor(ingest/tableau): cleanup duplicate lineage calls (#14018) 2025-07-10 21:06:09 -07:00