905 Commits

Author SHA1 Message Date
Jonny Dixon
9c718c870e
feat(ingestion/neo4j): Add stateful_ingestion and platform_instance capabilities to connector (#12631)
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2025-04-26 11:52:20 +01:00
david-leifker
9b0634805a
feat(ingestion-openapi): patch support (#13282)
Co-authored-by: Sergio Gómez Villamor <sgomezvillamor@gmail.com>
2025-04-25 13:54:28 -05:00
Sergio Gómez Villamor
1c5b7c18fc
chore(ingestion): removes ignore for SIM117 ruff rule (#13295) 2025-04-23 15:55:46 +02:00
Sergio Gómez Villamor
1563b0e9fb
fix(ingestion): use default generate_browse_path_v2 even if no pipeline_config (#13117) 2025-04-23 13:25:58 +02:00
Aseem Bansal
1de5fb3e6f
fix(cli): redact more secrets (#13287) 2025-04-23 14:49:26 +05:30
Harshal Sheth
f48c6b53ee
feat(ingest/snowflake): show returned query row counts (#13246) 2025-04-21 14:41:40 -07:00
Chakru
54156ea78a
fix(cli): use patch to update dataset properties (#13226) 2025-04-21 14:41:31 -07:00
Harshal Sheth
64bda48b51
feat(sdk): auto-fix bad entity type casing (#13218) 2025-04-20 21:40:00 -07:00
skrydal
47490ec050
feat(ingestion/iceberg): Add capability to extract namespace properties to the iceberg ingestor (#13238) 2025-04-17 16:29:43 +02:00
Hyejin Yoon
72aab9fe63
feat(sdk): add sdk lineage client (#13244)
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2025-04-17 17:44:07 +09:00
Hyejin Yoon
bafd93d38f
feat(sdk): add mlmodel and mlmodelgroup (#13150) 2025-04-15 16:12:38 +09:00
Andrew Sikowitz
3e37f76428
feat(ingest/tableau): Allow specifying asset types for ingest_hidden_assets (#13190) 2025-04-11 20:07:37 -07:00
ryota-cloud
ca4eab52e4
VertexAI Connector (v3 - pipeline and pipeline task) (#12960) 2025-04-10 22:54:17 -07:00
Michael Minichino
0b105395e9
feat(ingest/powerbi): Support ODBC Data Source (#13090) 2025-04-10 08:57:37 -05:00
Sergio Gómez Villamor
e7d8f2913c
fix(snowflake): fixes deduplication and fingerprint requirements for Hex (#13121) 2025-04-09 10:17:43 +02:00
Sergio Gómez Villamor
5c7b8e10ce
fix(hex): filter out queries if non scheduled runs (#13126) 2025-04-08 20:55:28 +02:00
skrydal
38f1553315
feat(ingestion): Refactoring timestamping logic for WorkUnits + custom logic for Iceberg (#13030)
Co-authored-by: Sergio Gómez Villamor <sgomezvillamor@gmail.com>
2025-04-04 22:30:27 +02:00
Sergio Gómez Villamor
b37fa03846
chore: fixes SIM118 ruff rule (#13069) 2025-04-04 11:59:43 +02:00
Sergio Gómez Villamor
d2bb33f7c5
feat(ingest): new hex connector - part 2 (#12985) 2025-04-03 12:44:37 +02:00
ryota-cloud
ebea3b7ca3
fix(ingestion) create ExperimentKey instead of containerKeyId used in MLflow and Vertex AI (#12995) 2025-04-01 00:00:09 -07:00
Harshal Sheth
58169ad7cc
fix(sdk): fix bugs in v2 sdk search client (#13026) 2025-03-31 08:59:32 -07:00
Chakru
d2dd54acf1
feat(dataset_cli): add dry-run support (#12814) 2025-03-29 18:08:52 +05:30
Harshal Sheth
5bc8a895f9
chore(ingest): remove calls to deprecated methods (#13009) 2025-03-28 13:42:54 -07:00
Harshal Sheth
716bf87f8f
fix(ingest): make emitter endpoint fully env-controlled (#13019) 2025-03-28 12:21:54 -07:00
skrydal
b7bb0b056c
feat(ingestion/iceberg): Refactor iceberg connector (#12921) 2025-03-28 18:34:36 +01:00
Harshal Sheth
29e09185eb
fix(ingest): warn when API tracing is unexpectedly inactive (#13007) 2025-03-27 22:21:33 -07:00
Mayuri Nehate
1bf395bf55
fix(ingest): split merge statements correctly (#12989) 2025-03-27 14:24:50 +05:30
Tamas Nemeth
a61a5856c0
fix(ingest/gc): Fix for slow soft-deleted entity deletion (#12931) 2025-03-27 09:43:48 +01:00
ryota-cloud
7cc0301fd5
fix(ingestion) Added externalURL of model group for Vertex AI (#12981) 2025-03-26 12:32:46 -07:00
Mayuri Nehate
ac9997d970
feat(ingest/snowflake): ingest stored procedures (#12929)
Co-authored-by: Sergio Gómez Villamor <sgomezvillamor@gmail.com>
2025-03-26 20:02:55 +05:30
Sergio Gómez Villamor
29d05c214a
feat(hex): warehouse integration via Query enrichment (#12949) 2025-03-26 09:35:50 +01:00
Sergio Gómez Villamor
5c58dbacce
feat(ingest): new hex connector - part 1 (#12915) 2025-03-25 19:47:11 +01:00
Günther Hackl
f48b8dd6c0
fix(ingestion): schema-metadata - fix jsonProps not being ingested for optional fields (#12927)
Co-authored-by: Sergio Gómez Villamor <sgomezvillamor@gmail.com>
2025-03-22 08:41:11 -07:00
ryota-cloud
9f8753bcb2
feat(ingestion) Adding vertexAI ingestion source (v2 - experiment and experiment run) (#12836) 2025-03-21 14:06:17 -07:00
Mayuri Nehate
8323bc3910
fix(ingest/dremio): simplify and fix build source map (#12908) 2025-03-21 11:31:16 +05:30
Hyejin Yoon
ac2a8e2ef0
feat(ingest/mlflow): add dataset lineage (#12837) 2025-03-21 08:38:43 +09:00
skrydal
1185ba8121
feat(ingestion/iceberg): Refactor iceberg source to use MCPWs instead of MCEs (#12912) 2025-03-20 10:46:08 +01:00
Austin SeungJun Park
41895fe24f
feat(ingest/s3): add table filtering (#12661) 2025-03-20 07:57:43 +01:00
Peter Wang
cffc6d4693
feat(ingestion/superset): superset column level lineage (#12786) 2025-03-14 08:02:54 -07:00
skrydal
ba8932cdc2
fix(ingest/snowflake): Fixing table rename query handling (#12852) 2025-03-13 23:26:23 +01:00
ryota-cloud
0e62e8c77a
feat(ingestion) Adding vertexAI ingestion source (v1 - model group and model) (#12632) 2025-03-13 11:02:15 -07:00
david-leifker
ebd3a5078d
feat(ingestion-tracing): implement ingestion with tracing api (#12714) 2025-03-13 11:33:28 -05:00
david-leifker
fa4ff7bced
feat(openapi-ingestion): implement openapi ingestion (#12757) 2025-03-11 08:25:53 -05:00
Mayuri Nehate
31df9c4e67
feat(ingest/redshift): lineage for external schema created from redshift (#12826) 2025-03-11 17:43:34 +05:30
Harshal Sheth
a6461853dc
feat(ingest): improve extract-sql-agg-log command (#12803) 2025-03-06 11:08:56 -08:00
Jonny Dixon
a700448bad
feat(ingestion/business-glossary): Automatically generate predictable glossary term and node URNs when incompatible URL characters are specified in term and node names. (#12673) 2025-03-06 14:30:10 +00:00
Mayuri Nehate
4714f46f11
feat(ingest/redshift): support for datashares lineage (#12660)
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2025-03-06 19:37:18 +05:30
Harshal Sheth
de60ca30e8
fix(ingest): enable fuzzy case resolution for oracle sql (#12778) 2025-03-05 10:28:29 -08:00
Sergio Gómez Villamor
a0319af7db
fix(ingestion): fixes producing some URNs with reserved characters (#12772) 2025-03-05 14:25:20 +01:00
Sergio Gómez Villamor
aed2433c4c
fix: fixes mypy complaints about pkgresources (#12790) 2025-03-05 12:41:03 +01:00