1815 Commits

Author SHA1 Message Date
Michael Minichino
340b1bf930
feat(ingest/excel): Add Excel Source (#13261)
Co-authored-by: Sergio Gómez Villamor <sgomezvillamor@gmail.com>
2025-08-28 08:03:37 +00:00
Harshal Sheth
5b864143c0
chore(ingest): update path to sample-dbt repo (#14579) 2025-08-27 14:25:12 -07:00
Michael Minichino
0252818bd0
feat(ingest/powerbi): Add ODBC SQL query parsing with DSN-to-database/schema mapping (#13752)
Co-authored-by: Sergio Gómez Villamor <sgomezvillamor@gmail.com>
Co-authored-by: Claude <noreply@anthropic.com>
2025-08-27 15:25:23 +05:30
Sergio Gómez Villamor
add6d88b77
fix(ingest/grafana): add provisioning verification to prevent test race conditions (#14566)
Co-authored-by: Cursor Agent <cursoragent@cursor.com>
Co-authored-by: hsheth2 <hsheth2@gmail.com>
2025-08-27 00:23:05 +00:00
Michael Maltese
da127b92df
feat(s3): support wildcards in bucket name component of path_specs (#14549) 2025-08-26 16:29:52 -04:00
Jonny Dixon
0462415095
feat(ingestion/sql-queries): support incremental lineage (#14548) 2025-08-26 10:02:40 +01:00
Sergio Gómez Villamor
b3f20ee437
test(ingestion/json-schema): add test for JSON Schema $ref loop in definitions (#14536) 2025-08-25 07:21:50 +02:00
Jonny Dixon
88842566cf
fix(ingestion/grafana): stabilize integration tests (#14547) 2025-08-22 19:38:29 +01:00
Sergio Gómez Villamor
b3fafc38be
feat(snowflake): ingest views from information schema (#14444)
Co-authored-by: Claude <noreply@anthropic.com>
2025-08-22 11:13:04 +02:00
Jonny Dixon
d7a64258d1
feat(ingestion/dbt): allow for dbt resources to be secondaries in sibling relationship on switch (#13230)
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2025-08-22 07:32:18 +01:00
Harshal Sheth
e6ac57f465
chore(ingest): remove pickle from stateful ingestion (#14531) 2025-08-21 16:12:47 -07:00
Anush Kumar
d64d296639
fix(ingestion): updated schema name handling to support Snowflake quoted identifiers #14210 (#14523) 2025-08-21 15:44:06 -07:00
Anush Kumar
bf09c5eebf
fix(ingestion): updated json_extract function for postgres db #12604 (#14533) 2025-08-21 15:42:51 -07:00
Harshal Sheth
995a7d6b09
chore(ingest): disable Vertica tests (#14521) 2025-08-20 14:40:42 -07:00
Benjamin Maquet
952807eb13
fix(cli): skip version warning message for servers (#14470) 2025-08-19 21:07:46 +05:30
Aseem Bansal
9a741dc92f
fix(ingest): exclude soft deleted entities from counts (#14490) 2025-08-19 17:10:53 +05:30
Aseem Bansal
8e830d1ef6
Revert "feat(ingest/snowflake): breaking change for match_fully_qualified_names" (#14465) 2025-08-15 11:13:53 +05:30
Aseem Bansal
bb4d747e39
feat(ingest/snowflake): breaking change for match_fully_qualified_names (#13852) 2025-08-13 15:44:59 +05:30
Sergio Gómez Villamor
22bce85410
feat(snowflake): enhance pushdown_deny_usernames by allowing patterns and add pushdown_allow_usernames (#14428) 2025-08-13 11:58:23 +02:00
Michael Maltese
738f16ce91
fix(ingest/hex): use viewer external URL for published projects/components (#14353) 2025-08-12 12:43:19 -04:00
Tamas Nemeth
6fa4f3e590
fix(ingest/unity): Add option to set databricks api page size (#14430) 2025-08-12 13:38:32 +02:00
Benjamin Maquet
48f5ba466d
feat(superset/preset): add column-level-lineage support for aggregate charts (#14242)
Thanks for the contribution!
2025-08-12 09:17:10 +02:00
Tamas Nemeth
f1e7ce72f0
fix(ingest/looker): Ignore fields with empty column name to not generate invalid field urns (#14338) 2025-08-12 08:55:14 +02:00
Tamas Nemeth
6787d83fa6
fix(ingest/unity-catalog): Speed up tag extraction by caching platform resources (#14376)
The pr reworks the external entity api for platform resources
2025-08-11 22:51:25 +02:00
Jonny Dixon
c12e4b27e7
feat(ingestion/snowflake): formal support of dynamic tables (#13542) 2025-08-11 19:17:27 +01:00
Aarush
adf00c199d
feat(mysql): add support for stored procedures in mysql ingestion (#14274) 2025-08-11 18:51:15 +09:00
Aseem Bansal
26b0d51854
fix(ingest): separate out existence dict and full count dict (#14396) 2025-08-08 18:37:24 +05:30
Benjamin Maquet
ed3cfc5d42
fix(ingest/dbt-cloud): use correct node description for sources (#14321) 2025-08-07 13:53:04 -07:00
Andrew Sikowitz
bd2198fcdc
feat(sdk/patch): Support DataJob fine grained lineage patch (#14377) 2025-08-07 13:07:38 -07:00
Tamas Nemeth
154c065aa8
feat(ingest/sdkv2): Add skip cache parameter to urn search (#14369) 2025-08-07 18:22:08 +02:00
Tamas Nemeth
ea091bb9cc
feat(ingest/unity): Get table lineage from system table (#14282) 2025-08-06 21:11:43 +02:00
Tamas Nemeth
560b5ec54e
fix(ingest/glue): Add fix for empty script path in glue (#14324) 2025-08-06 09:27:34 +02:00
Tamas Nemeth
86ffe5223d
feat(ingest/sdkv2): Add way to pass in emit_mode to entity client update and upsert (#14336)
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2025-08-06 08:40:23 +02:00
Tamas Nemeth
8845cf27f8
fix(ingest/api): External tag (UnityTag, LakeFormationTag) fixes (#14322) 2025-08-05 10:08:45 -07:00
Aseem Bansal
da0cb6d093
test(cli/upgrade): add unit test for check upgrade (#14313) 2025-08-05 14:52:01 +05:30
Gabe Lyons
3abeadde4e
feat(meta-mappping): support meta mappings of lists (#14306) 2025-08-01 12:26:45 -07:00
Tamas Nemeth
d0f894f7d1
feat(ingest/lookml): Lookml incremental expression support (#14289) 2025-08-01 11:49:49 +02:00
Harshal Sheth
fe3ffc1c27
revert(ingest): Extending file sink to support writing to S3 (#14160) (#14248) 2025-07-29 12:13:26 +02:00
Harshal Sheth
da9121d9cc
feat(ingest): improve CI batches (#14239) 2025-07-28 16:34:15 -07:00
Harshal Sheth
604fd34f76
chore(ingest): reduce Okta test warnings (#14234) 2025-07-28 10:17:39 -07:00
John Joyce
9ff5a2cf9d
feat(ingest): Extending file sink to support writing to S3 (#14160)
Co-authored-by: John Joyce <john@Mac-2290.lan>
Co-authored-by: John Joyce <john@Mac-2536.lan>
2025-07-28 09:18:44 -07:00
Sergio Gómez Villamor
7a27e8e7fd
fix(ingest/sql-queries): handle string timestamps and empty table names (#14205)
Co-authored-by: Claude <noreply@anthropic.com>
2025-07-25 22:33:49 +02:00
Harshal Sheth
9490eba8dc
fix(sdk): make Filter type parsing more permissive (#14212) 2025-07-25 09:37:23 -07:00
Sergio Gómez Villamor
e24fc39966
feat(sql-parsing-aggregator): add override_dialect for observed query (#14201) 2025-07-25 08:21:44 +02:00
mihai103
8e1fbaffad
Adding support for domains when upserting datasets with the cli (#14152)
Co-authored-by: Mihai Ciocirdel <mihai.ciocirdel@swisscom.com>
Co-authored-by: Hyejin Yoon <0327jane@gmail.com>
2025-07-24 17:35:17 -04:00
Sergio Gómez Villamor
fa946725b2
test(kafka-connect): update Debezium connectors to fix broken integration tests (#14213) 2025-07-24 13:36:28 -07:00
Harshal Sheth
446f31f1bd
feat(sdk): expose view definition in dataset sdk (#14197) 2025-07-24 10:14:30 -07:00
Jonny Dixon
836e301e3b
feat(ingestion/grafana): Add datasets and charts to dashboards with lineage and tags. Lineage back to source (#12417)
Co-authored-by: Sergio Gómez Villamor <sgomezvillamor@gmail.com>
2025-07-24 17:05:09 +01:00
Sergio Gómez Villamor
34d653e88f
feat(ingest/sql-queries): integrate SQL parsing aggregator with enhanced features (#14190) 2025-07-24 11:40:04 +02:00
Sergio Gómez Villamor
8fe536fd34
tests(sql-queries): add SQL queries integration tests (#14176) 2025-07-24 10:01:29 +02:00