4218 Commits

Author SHA1 Message Date
Tamas Nemeth
742409fddc
fix(ingestion/nifi): Change Zookeeper image to bitnamilegacy version in test (#14626) 2025-09-02 18:15:33 +05:30
Hyejin Yoon
584f6ce3d0
feat(ingest/unity) : add mlmodel / mlmodel version support (#14594) 2025-09-02 15:22:17 +09:00
Sergio Gómez Villamor
3401821f60
test(snowflake): add test for include_queries=False behavior (#14617)
Co-authored-by: Tim Drahn <tkdrahn@gmail.com>
Co-authored-by: Claude <noreply@anthropic.com>
2025-09-01 16:37:00 +00:00
Tim Drahn
8e468c82ec
fix(snowflake): honor include_queries flag (#14452)
Co-authored-by: Sergio Gómez Villamor <sgomezvillamor@gmail.com>
2025-09-01 17:31:14 +02:00
skrydal
9698850f08
fix(ingestion/snowflake): Fix views schema extraction for corner cases (#14601) 2025-08-29 21:01:54 +00:00
Anush Kumar
be8c684b35
refactor(ingestion): renamed redshift lineage_v2 to lineage and other v2 nomenclatures (#14603) 2025-08-29 11:37:26 -07:00
sleeperdeep
73a351f92f
feat(mssql): quote_schemas & odbc_connect fields with related logic were added to SQLServerConfig (#13771)
Co-authored-by: Sergio Gómez Villamor <sgomezvillamor@gmail.com>
2025-08-29 18:16:19 +00:00
Anush Kumar
b64f2a1533
refactor(ingestion): Updated Redshift lineage_v1 refs and removed v1 implementation (#14580) 2025-08-29 10:09:10 -07:00
Sergio Gómez Villamor
3e2883936b
fix(excel): Add missing dependencies (#14592)
Co-authored-by: Claude <noreply@anthropic.com>
2025-08-29 10:16:11 +00:00
Sergio Gómez Villamor
ea0677b918
feat(snowflake): add China region support (#14434)
Co-authored-by: Claude <noreply@anthropic.com>
2025-08-29 10:01:52 +02:00
Sergio Gómez Villamor
67a441f312
fix(tool_meta_extractor): relax hex query detection to search entire query text (#14582) 2025-08-28 13:22:40 +02:00
Mayuri Nehate
fe8f108746
fix(sdk): make Filter type permissive of implicit and dict (#14569) 2025-08-28 15:22:00 +05:30
Michael Minichino
340b1bf930
feat(ingest/excel): Add Excel Source (#13261)
Co-authored-by: Sergio Gómez Villamor <sgomezvillamor@gmail.com>
2025-08-28 08:03:37 +00:00
Harshal Sheth
5b864143c0
chore(ingest): update path to sample-dbt repo (#14579) 2025-08-27 14:25:12 -07:00
Michael Maltese
c2f9fc812c
feat(models): support charts in edges fields of other charts (#14339) 2025-08-27 12:37:08 -04:00
Michael Minichino
0252818bd0
feat(ingest/powerbi): Add ODBC SQL query parsing with DSN-to-database/schema mapping (#13752)
Co-authored-by: Sergio Gómez Villamor <sgomezvillamor@gmail.com>
Co-authored-by: Claude <noreply@anthropic.com>
2025-08-27 15:25:23 +05:30
kammillam
ef11b16632
fix(ingestion/openapi): Update method comparison for openapi (#14311)
Co-authored-by: Sergio Gómez Villamor <sgomezvillamor@gmail.com>
2025-08-27 15:24:53 +05:30
Sergio Gómez Villamor
add6d88b77
fix(ingest/grafana): add provisioning verification to prevent test race conditions (#14566)
Co-authored-by: Cursor Agent <cursoragent@cursor.com>
Co-authored-by: hsheth2 <hsheth2@gmail.com>
2025-08-27 00:23:05 +00:00
Michael Maltese
da127b92df
feat(s3): support wildcards in bucket name component of path_specs (#14549) 2025-08-26 16:29:52 -04:00
Michael Maltese
8e1112a0d1
fix(ingest/dynamodb): clean up starter DynamoDB recipes (#14476) 2025-08-26 16:29:05 -04:00
Aseem Bansal
ec25174c36
fix(ingest): add missing subtype modifier (#14563) 2025-08-26 21:49:55 +05:30
Jonny Dixon
0462415095
feat(ingestion/sql-queries): support incremental lineage (#14548) 2025-08-26 10:02:40 +01:00
Sergio Gómez Villamor
b3f20ee437
test(ingestion/json-schema): add test for JSON Schema $ref loop in definitions (#14536) 2025-08-25 07:21:50 +02:00
Jonny Dixon
88842566cf
fix(ingestion/grafana): stabilize integration tests (#14547) 2025-08-22 19:38:29 +01:00
Sergio Gómez Villamor
b3fafc38be
feat(snowflake): ingest views from information schema (#14444)
Co-authored-by: Claude <noreply@anthropic.com>
2025-08-22 11:13:04 +02:00
Jonny Dixon
d7a64258d1
feat(ingestion/dbt): allow for dbt resources to be secondaries in sibling relationship on switch (#13230)
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2025-08-22 07:32:18 +01:00
Harshal Sheth
e6ac57f465
chore(ingest): remove pickle from stateful ingestion (#14531) 2025-08-21 16:12:47 -07:00
Anush Kumar
d64d296639
fix(ingestion): updated schema name handling to support Snowflake quoted identifiers #14210 (#14523) 2025-08-21 15:44:06 -07:00
Anush Kumar
bf09c5eebf
fix(ingestion): updated json_extract function for postgres db #12604 (#14533) 2025-08-21 15:42:51 -07:00
Harshal Sheth
829cf62fc3
docs(sdk): update read_* examples to not also create (#14506) 2025-08-21 14:51:11 -07:00
Harshal Sheth
653952e714
docs(sdk): improve sdk examples + docs (#14507) 2025-08-21 10:22:08 -07:00
Gabe Lyons
f257907127
docs(applications): Feature Guide for Applications (#14178)
Co-authored-by: Maggie Hays <maggiem.hays@gmail.com>
2025-08-20 15:45:29 -07:00
Harshal Sheth
995a7d6b09
chore(ingest): disable Vertica tests (#14521) 2025-08-20 14:40:42 -07:00
Harshal Sheth
f4cfed9e6d
chore(ingest): update url for GX fork (#14508) 2025-08-20 09:08:33 -07:00
Aseem Bansal
a52b7fa074
doc(sql): add doc on sql aggregator (#14496) 2025-08-20 20:33:08 +05:30
Michael Maltese
7d7f3ec273
feat(ingest/dynamodb): make max_schema_size configurable (#14477) 2025-08-20 08:34:49 -04:00
Benjamin Maquet
952807eb13
fix(cli): skip version warning message for servers (#14470) 2025-08-19 21:07:46 +05:30
skrydal
c0b32ced34
fix(ingestion): Bump jupyter server dependency (#14492) 2025-08-19 16:07:10 +02:00
Aseem Bansal
9a741dc92f
fix(ingest): exclude soft deleted entities from counts (#14490) 2025-08-19 17:10:53 +05:30
Aseem Bansal
8e830d1ef6
Revert "feat(ingest/snowflake): breaking change for match_fully_qualified_names" (#14465) 2025-08-15 11:13:53 +05:30
Aseem Bansal
bb4d747e39
feat(ingest/snowflake): breaking change for match_fully_qualified_names (#13852) 2025-08-13 15:44:59 +05:30
Aseem Bansal
582983ca27
fix(mock-data): properly add run id (#14432) 2025-08-13 15:28:47 +05:30
Sergio Gómez Villamor
22bce85410
feat(snowflake): enhance pushdown_deny_usernames by allowing patterns and add pushdown_allow_usernames (#14428) 2025-08-13 11:58:23 +02:00
Michael Maltese
738f16ce91
fix(ingest/hex): use viewer external URL for published projects/components (#14353) 2025-08-12 12:43:19 -04:00
Tamas Nemeth
6fa4f3e590
fix(ingest/unity): Add option to set databricks api page size (#14430) 2025-08-12 13:38:32 +02:00
Benjamin Maquet
48f5ba466d
feat(superset/preset): add column-level-lineage support for aggregate charts (#14242)
Thanks for the contribution!
2025-08-12 09:17:10 +02:00
Tamas Nemeth
f1e7ce72f0
fix(ingest/looker): Ignore fields with empty column name to not generate invalid field urns (#14338) 2025-08-12 08:55:14 +02:00
Tamas Nemeth
6787d83fa6
fix(ingest/unity-catalog): Speed up tag extraction by caching platform resources (#14376)
The pr reworks the external entity api for platform resources
2025-08-11 22:51:25 +02:00
Jonny Dixon
c12e4b27e7
feat(ingestion/snowflake): formal support of dynamic tables (#13542) 2025-08-11 19:17:27 +01:00
Aarush
adf00c199d
feat(mysql): add support for stored procedures in mysql ingestion (#14274) 2025-08-11 18:51:15 +09:00