935 Commits

Author SHA1 Message Date
Harshal Sheth
58169ad7cc
fix(sdk): fix bugs in v2 sdk search client (#13026) 2025-03-31 08:59:32 -07:00
Chakru
d2dd54acf1
feat(dataset_cli): add dry-run support (#12814) 2025-03-29 18:08:52 +05:30
Harshal Sheth
5bc8a895f9
chore(ingest): remove calls to deprecated methods (#13009) 2025-03-28 13:42:54 -07:00
Harshal Sheth
716bf87f8f
fix(ingest): make emitter endpoint fully env-controlled (#13019) 2025-03-28 12:21:54 -07:00
skrydal
b7bb0b056c
feat(ingestion/iceberg): Refactor iceberg connector (#12921) 2025-03-28 18:34:36 +01:00
Harshal Sheth
29e09185eb
fix(ingest): warn when API tracing is unexpectedly inactive (#13007) 2025-03-27 22:21:33 -07:00
Mayuri Nehate
1bf395bf55
fix(ingest): split merge statements correctly (#12989) 2025-03-27 14:24:50 +05:30
Tamas Nemeth
a61a5856c0
fix(ingest/gc): Fix for slow soft-deleted entity deletion (#12931) 2025-03-27 09:43:48 +01:00
ryota-cloud
7cc0301fd5
fix(ingestion) Added externalURL of model group for Vertex AI (#12981) 2025-03-26 12:32:46 -07:00
Mayuri Nehate
ac9997d970
feat(ingest/snowflake): ingest stored procedures (#12929)
Co-authored-by: Sergio Gómez Villamor <sgomezvillamor@gmail.com>
2025-03-26 20:02:55 +05:30
Sergio Gómez Villamor
29d05c214a
feat(hex): warehouse integration via Query enrichment (#12949) 2025-03-26 09:35:50 +01:00
Sergio Gómez Villamor
5c58dbacce
feat(ingest): new hex connector - part 1 (#12915) 2025-03-25 19:47:11 +01:00
Günther Hackl
f48b8dd6c0
fix(ingestion): schema-metadata - fix jsonProps not being ingested for optional fields (#12927)
Co-authored-by: Sergio Gómez Villamor <sgomezvillamor@gmail.com>
2025-03-22 08:41:11 -07:00
ryota-cloud
9f8753bcb2
feat(ingestion) Adding vertexAI ingestion source (v2 - experiment and experiment run) (#12836) 2025-03-21 14:06:17 -07:00
Mayuri Nehate
8323bc3910
fix(ingest/dremio): simplify and fix build source map (#12908) 2025-03-21 11:31:16 +05:30
Hyejin Yoon
ac2a8e2ef0
feat(ingest/mlflow): add dataset lineage (#12837) 2025-03-21 08:38:43 +09:00
skrydal
1185ba8121
feat(ingestion/iceberg): Refactor iceberg source to use MCPWs instead of MCEs (#12912) 2025-03-20 10:46:08 +01:00
Austin SeungJun Park
41895fe24f
feat(ingest/s3): add table filtering (#12661) 2025-03-20 07:57:43 +01:00
Peter Wang
cffc6d4693
feat(ingestion/superset): superset column level lineage (#12786) 2025-03-14 08:02:54 -07:00
skrydal
ba8932cdc2
fix(ingest/snowflake): Fixing table rename query handling (#12852) 2025-03-13 23:26:23 +01:00
ryota-cloud
0e62e8c77a
feat(ingestion) Adding vertexAI ingestion source (v1 - model group and model) (#12632) 2025-03-13 11:02:15 -07:00
david-leifker
ebd3a5078d
feat(ingestion-tracing): implement ingestion with tracing api (#12714) 2025-03-13 11:33:28 -05:00
david-leifker
fa4ff7bced
feat(openapi-ingestion): implement openapi ingestion (#12757) 2025-03-11 08:25:53 -05:00
Mayuri Nehate
31df9c4e67
feat(ingest/redshift): lineage for external schema created from redshift (#12826) 2025-03-11 17:43:34 +05:30
Harshal Sheth
a6461853dc
feat(ingest): improve extract-sql-agg-log command (#12803) 2025-03-06 11:08:56 -08:00
Jonny Dixon
a700448bad
feat(ingestion/business-glossary): Automatically generate predictable glossary term and node URNs when incompatible URL characters are specified in term and node names. (#12673) 2025-03-06 14:30:10 +00:00
Mayuri Nehate
4714f46f11
feat(ingest/redshift): support for datashares lineage (#12660)
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2025-03-06 19:37:18 +05:30
Harshal Sheth
de60ca30e8
fix(ingest): enable fuzzy case resolution for oracle sql (#12778) 2025-03-05 10:28:29 -08:00
Sergio Gómez Villamor
a0319af7db
fix(ingestion): fixes producing some URNs with reserved characters (#12772) 2025-03-05 14:25:20 +01:00
Sergio Gómez Villamor
aed2433c4c
fix: fixes mypy complaints about pkgresources (#12790) 2025-03-05 12:41:03 +01:00
Kevin Karch
f32798125b
feat(ingest): allowdenypattern for dashboard, chart, dataset in superset (#12782) 2025-03-04 17:59:42 -05:00
Peter Wang
9e7f48278a
feat(ingestion/superset): ownership info for charts, dashboards and datasets (#12750) 2025-03-04 12:28:24 -08:00
Chakru
be42e11bd2
dataset cli - add support for schema, round-tripping to yaml (#12764) 2025-03-04 10:17:51 -08:00
Harshal Sheth
6097820c81
feat(sdk): add support for institutional memory links (#12770) 2025-03-04 08:45:01 -08:00
Harshal Sheth
12eb0cd1a7
feat(sdk): add search client (#12754) 2025-03-03 10:05:26 -08:00
skrydal
3e1b20c727
feat(ingestion/iceberg): Several improvements to iceberg connector (#12744) 2025-03-01 01:30:07 +01:00
Harshal Sheth
f3b17d4d4c
feat(ingest): improve error messages for unknown metadata objects (#12745) 2025-02-28 12:36:58 -08:00
Austin SeungJun Park
e65f133667
refactor(ingest/s3): enhance readability (#12686) 2025-02-28 14:19:46 +01:00
Aseem Bansal
9c3bd34995
dev: enable ruff rule (#12749) 2025-02-28 17:49:52 +05:30
Rajat Goel
c4e5a9e9c3
feat(ingest/metabase): API key support in Metabase source (#12711) 2025-02-28 11:01:07 +05:30
Aseem Bansal
2101a50e83
dev: immutable args remove (#12735) 2025-02-27 15:38:47 +05:30
Rasnar
5f5e395c90
Fix platform instance support on Druid ingestion (#12716)
Co-authored-by: rasnar <11248833+Rasnar@users.noreply.github.com>
Co-authored-by: Sergio Gómez Villamor <sgomezvillamor@gmail.com>
2025-02-26 08:36:06 +01:00
david-leifker
2396f0e23d
fix(urn-validation): additional test cases for urn validation (#12727) 2025-02-25 15:57:17 -06:00
cccs-cat001
cb67726ab4
fix(ingest): handle groups in pattern_cleanup_ownership transformer (#12536) 2025-02-24 14:47:46 -08:00
Aseem Bansal
d1494c2252
dev: upgrade ruff, remove 2 ruff ignore rules (#12702) 2025-02-24 14:07:57 +05:30
Harshal Sheth
9759a58d04
docs(ingest): add more details on SQL parser limitations (#12669) 2025-02-21 16:16:07 -08:00
ttekampe
27e72782b9
fix(mssql): correctly split stored procs SQL (#12618)
Co-authored-by: Tobias Tekampe <tobias.tekampe@movingdots.com>
2025-02-18 12:09:06 -08:00
Gabe Lyons
401a1fb731
[BREAKING CHANGE] fix(openapi): fixing openapi nesting (#12580) 2025-02-18 06:05:54 -08:00
Harshal Sheth
dce21bac1e
feat(sdk): add/remove methods + other small improvements (#12646) 2025-02-17 18:27:46 -08:00
Aseem Bansal
2ecd3bbab8
feat(cli): add extra pip and debug flag (#12621) 2025-02-17 16:03:07 +05:30