1604 Commits

Author SHA1 Message Date
Mayuri Nehate
a3a1f50886
fix(ingest/dbt): consider dbt run results with success status (#12942) 2025-03-24 15:09:48 +05:30
Günther Hackl
f48b8dd6c0
fix(ingestion): schema-metadata - fix jsonProps not being ingested for optional fields (#12927)
Co-authored-by: Sergio Gómez Villamor <sgomezvillamor@gmail.com>
2025-03-22 08:41:11 -07:00
ryota-cloud
9f8753bcb2
feat(ingestion) Adding vertexAI ingestion source (v2 - experiment and experiment run) (#12836) 2025-03-21 14:06:17 -07:00
Peter Wang
6914df3721
feat(ingestion/superset): add timeout values to config to prevent hanging queries from blocking ingestion (#12884) 2025-03-21 08:08:56 -07:00
Mayuri Nehate
8323bc3910
fix(ingest/dremio): simplify and fix build source map (#12908) 2025-03-21 11:31:16 +05:30
Hyejin Yoon
ac2a8e2ef0
feat(ingest/mlflow): add dataset lineage (#12837) 2025-03-21 08:38:43 +09:00
skrydal
1185ba8121
feat(ingestion/iceberg): Refactor iceberg source to use MCPWs instead of MCEs (#12912) 2025-03-20 10:46:08 +01:00
Austin SeungJun Park
41895fe24f
feat(ingest/s3): add table filtering (#12661) 2025-03-20 07:57:43 +01:00
Sergio Gómez Villamor
2aba2e3ed8
fix(powerbi): fixes direction of the dashboard-report lineage (#12881) 2025-03-19 12:25:42 +01:00
Gabe Lyons
ecd9ffd137
feat(openapi): Adding subtype for openapi source (#12873) 2025-03-18 12:35:46 -07:00
Peter Wang
cffc6d4693
feat(ingestion/superset): superset column level lineage (#12786) 2025-03-14 08:02:54 -07:00
skrydal
ba8932cdc2
fix(ingest/snowflake): Fixing table rename query handling (#12852) 2025-03-13 23:26:23 +01:00
Deepak Garg
eb17f80e8a
feat(ingest/hive): identify partition columns in hive tables (#12833) 2025-03-13 11:37:52 -07:00
ryota-cloud
0e62e8c77a
feat(ingestion) Adding vertexAI ingestion source (v1 - model group and model) (#12632) 2025-03-13 11:02:15 -07:00
david-leifker
ebd3a5078d
feat(ingestion-tracing): implement ingestion with tracing api (#12714) 2025-03-13 11:33:28 -05:00
Mayuri Nehate
f9d71d67a0
feat(ingest/salesforce): include formula in in field description (#12840) 2025-03-13 22:00:06 +05:30
Hyejin Yoon
86f4b805cf
feat(ingest/mlflow): update dpi to use edge for lineage (#12861) 2025-03-13 10:05:00 +09:00
david-leifker
fa4ff7bced
feat(openapi-ingestion): implement openapi ingestion (#12757) 2025-03-11 08:25:53 -05:00
Mayuri Nehate
31df9c4e67
feat(ingest/redshift): lineage for external schema created from redshift (#12826) 2025-03-11 17:43:34 +05:30
Sergio Gómez Villamor
dd371130c1
chore(ruff): enable some ignored rules (#12815) 2025-03-11 09:30:06 +01:00
Hyejin Yoon
8bf1f718da
feat(ingestion/mlflow): improve mlflow connector to pull run and experiments (#12587) 2025-03-11 07:55:48 +09:00
Peter Wang
48b6581f12
fix(ingest/superset): fixed iterate over int error for building urns (#12807)
Co-authored-by: Sergio Gómez Villamor <sgomezvillamor@gmail.com>
2025-03-07 15:41:27 -08:00
Harshal Sheth
55fbb71a53
fix(ingest/oracle): refresh golden files (#12818) 2025-03-07 12:38:39 -08:00
Harshal Sheth
a6461853dc
feat(ingest): improve extract-sql-agg-log command (#12803) 2025-03-06 11:08:56 -08:00
Jonny Dixon
fcabe88962
fix(ingestion/oracle): Improved foreign key handling (#11867)
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2025-03-06 14:32:03 +00:00
Jonny Dixon
a700448bad
feat(ingestion/business-glossary): Automatically generate predictable glossary term and node URNs when incompatible URL characters are specified in term and node names. (#12673) 2025-03-06 14:30:10 +00:00
Mayuri Nehate
4714f46f11
feat(ingest/redshift): support for datashares lineage (#12660)
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2025-03-06 19:37:18 +05:30
Harshal Sheth
de60ca30e8
fix(ingest): enable fuzzy case resolution for oracle sql (#12778) 2025-03-05 10:28:29 -08:00
Sergio Gómez Villamor
69981675a5
feat(mssql): adds subtypes aspect for dataflow and datajobs (#12775) 2025-03-05 17:11:04 +01:00
Sergio Gómez Villamor
85d3a9d31d
feat(okta): custom properties for okta user (#12773) 2025-03-05 15:53:01 +01:00
Sergio Gómez Villamor
a0319af7db
fix(ingestion): fixes producing some URNs with reserved characters (#12772) 2025-03-05 14:25:20 +01:00
Sergio Gómez Villamor
aed2433c4c
fix: fixes mypy complaints about pkgresources (#12790) 2025-03-05 12:41:03 +01:00
Kevin Karch
f32798125b
feat(ingest): allowdenypattern for dashboard, chart, dataset in superset (#12782) 2025-03-04 17:59:42 -05:00
Peter Wang
9e7f48278a
feat(ingestion/superset): ownership info for charts, dashboards and datasets (#12750) 2025-03-04 12:28:24 -08:00
Chakru
be42e11bd2
dataset cli - add support for schema, round-tripping to yaml (#12764) 2025-03-04 10:17:51 -08:00
Harshal Sheth
6097820c81
feat(sdk): add support for institutional memory links (#12770) 2025-03-04 08:45:01 -08:00
Harshal Sheth
12eb0cd1a7
feat(sdk): add search client (#12754) 2025-03-03 10:05:26 -08:00
skrydal
3e1b20c727
feat(ingestion/iceberg): Several improvements to iceberg connector (#12744) 2025-03-01 01:30:07 +01:00
Harshal Sheth
f3b17d4d4c
feat(ingest): improve error messages for unknown metadata objects (#12745) 2025-02-28 12:36:58 -08:00
Peter Wang
fc26c1cfb5
feat(ingestion/superset): superset dataset lineage for metadata ingestion (#12679)
Co-authored-by: Shuixi Li <llance@users.noreply.github.com>
Co-authored-by: Gabe Lyons <gabe.lyons@acryl.io>
2025-02-28 07:29:25 -08:00
Austin SeungJun Park
e65f133667
refactor(ingest/s3): enhance readability (#12686) 2025-02-28 14:19:46 +01:00
Aseem Bansal
9c3bd34995
dev: enable ruff rule (#12749) 2025-02-28 17:49:52 +05:30
Rajat Goel
c4e5a9e9c3
feat(ingest/metabase): API key support in Metabase source (#12711) 2025-02-28 11:01:07 +05:30
Aseem Bansal
0fc074b50a
dev: enable ruff rule (#12742) 2025-02-28 10:59:06 +05:30
Aseem Bansal
2101a50e83
dev: immutable args remove (#12735) 2025-02-27 15:38:47 +05:30
Rasnar
5f5e395c90
Fix platform instance support on Druid ingestion (#12716)
Co-authored-by: rasnar <11248833+Rasnar@users.noreply.github.com>
Co-authored-by: Sergio Gómez Villamor <sgomezvillamor@gmail.com>
2025-02-26 08:36:06 +01:00
david-leifker
2396f0e23d
fix(urn-validation): additional test cases for urn validation (#12727) 2025-02-25 15:57:17 -06:00
Sergio Gómez Villamor
c980cbd8f2
tests(druid): integration tests for druid ingestion (#12717)
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2025-02-25 08:08:45 +01:00
cccs-cat001
cb67726ab4
fix(ingest): handle groups in pattern_cleanup_ownership transformer (#12536) 2025-02-24 14:47:46 -08:00
Harshal Sheth
8dfd8fbbaf
feat(ingest): migrate Cassandra source to new SDK (#12695) 2025-02-24 11:57:51 -08:00