927 Commits

Author SHA1 Message Date
Hyejin Yoon
f986315582
doc: Acryl to DataHub, datahubproject.io to datahub.com (#13252)
Co-authored-by: Jay <159848059+jayacryl@users.noreply.github.com>
2025-04-28 10:34:33 -04:00
Michael Minichino
fee67788a3
fix(ingest/mode): Add pagination and warn on missing reports (#13322) 2025-04-25 18:21:27 -05:00
Sergio Gómez Villamor
a8637abfe2
tests(kafka): fixing flaky tests (#13171) 2025-04-22 12:58:47 +02:00
Harshal Sheth
f48c6b53ee
feat(ingest/snowflake): show returned query row counts (#13246) 2025-04-21 14:41:40 -07:00
Chakru
54156ea78a
fix(cli): use patch to update dataset properties (#13226) 2025-04-21 14:41:31 -07:00
Harshal Sheth
08453cfbb1
fix(ingest/hive): support multiline view definitions (#13248) 2025-04-21 11:11:35 -07:00
Harshal Sheth
9f7f3cb886
chore(ingest/snowflake): remove unused query code (#13245) 2025-04-21 10:31:36 -07:00
Harshal Sheth
5ba8b7d173
fix(ingest/fivetran): use project id by default for bigquery (#13250) 2025-04-20 21:39:40 -07:00
skrydal
47490ec050
feat(ingestion/iceberg): Add capability to extract namespace properties to the iceberg ingestor (#13238) 2025-04-17 16:29:43 +02:00
Hyejin Yoon
72aab9fe63
feat(sdk): add sdk lineage client (#13244)
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2025-04-17 17:44:07 +09:00
Sergio Gómez Villamor
f3dfd86680
fix(looker): missing Looker Explore relationship when Look references multiple models (#13198) 2025-04-17 07:53:13 +02:00
Andrew Sikowitz
d138a64a6a
ci(graphql,workflows): Format .md, .graphql, and workflow .yml files via prettier (#13220) 2025-04-16 16:55:51 -07:00
Andrew Sikowitz
3e37f76428
feat(ingest/tableau): Allow specifying asset types for ingest_hidden_assets (#13190) 2025-04-11 20:07:37 -07:00
ryota-cloud
ca4eab52e4
VertexAI Connector (v3 - pipeline and pipeline task) (#12960) 2025-04-10 22:54:17 -07:00
Andrew Sikowitz
ca51df880f
fix(ingest/snowflake): Use CREATE change type when creating structured properties; support MCP headers (#13158) 2025-04-10 15:13:13 -05:00
Michael Minichino
0b105395e9
feat(ingest/powerbi): Support ODBC Data Source (#13090) 2025-04-10 08:57:37 -05:00
Sergio Gómez Villamor
4e48e098dc
fix(ingestion): fixes missing platform instance aspect for DataFlow entitiy (#13080) 2025-04-06 08:19:47 +02:00
Sergio Gómez Villamor
b37fa03846
chore: fixes SIM118 ruff rule (#13069) 2025-04-04 11:59:43 +02:00
Sergio Gómez Villamor
d2bb33f7c5
feat(ingest): new hex connector - part 2 (#12985) 2025-04-03 12:44:37 +02:00
Peter Wang
719cc67cac
feat(ingest/superset): leverage threads for superset API calls (#13006)
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2025-04-02 10:27:57 -07:00
Sergio Gómez Villamor
c6acce9906
feat(powerbi): capture dataset report lineage (#12993) 2025-04-01 11:12:47 +02:00
ryota-cloud
ebea3b7ca3
fix(ingestion) create ExperimentKey instead of containerKeyId used in MLflow and Vertex AI (#12995) 2025-04-01 00:00:09 -07:00
Gabe Lyons
ee4827e1b2
fix(oracle): fixing oracle CLL for view parsing. (#13029) 2025-03-30 07:42:55 -07:00
Michael Minichino
8757a0e01a
feat(ingest/powerbi): PowerBI source updates (#12857) 2025-03-28 13:22:25 -05:00
skrydal
b7bb0b056c
feat(ingestion/iceberg): Refactor iceberg connector (#12921) 2025-03-28 18:34:36 +01:00
Peter Wang
e0d805c8f7
feat(ingestion/superset): column level lineage for charts (#12930)
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
Co-authored-by: Jay <159848059+jayacryl@users.noreply.github.com>
Co-authored-by: Shuixi Li <llance@users.noreply.github.com>
Co-authored-by: Gabe Lyons <gabe.lyons@acryl.io>
Co-authored-by: Sergio Gómez Villamor <sgomezvillamor@gmail.com>
Co-authored-by: Chris Collins <chriscollins3456@gmail.com>
Co-authored-by: amit-apptware <132869468+amit-apptware@users.noreply.github.com>
Co-authored-by: Austin SeungJun Park <110667795+eagle-25@users.noreply.github.com>
Co-authored-by: skrydal <piotr.skrydalewicz@acryl.io>
Co-authored-by: Saketh Varma <sakethvarma397@gmail.com>
Co-authored-by: Dmitry Bryazgin <58312247+bda618@users.noreply.github.com>
Co-authored-by: Hyejin Yoon <0327jane@gmail.com>
Co-authored-by: John Joyce <john@acryl.io>
Co-authored-by: John Joyce <john@Mac.lan>
Co-authored-by: Chakru <161002324+chakru-r@users.noreply.github.com>
Co-authored-by: Mayuri Nehate <33225191+mayurinehate@users.noreply.github.com>
Co-authored-by: Maggie Hays <maggiem.hays@gmail.com>
Co-authored-by: Pedro Silva <pedro@acryl.io>
Co-authored-by: Gabe Lyons <itsgabelyons@gmail.com>
2025-03-27 08:05:54 -07:00
ryota-cloud
7cc0301fd5
fix(ingestion) Added externalURL of model group for Vertex AI (#12981) 2025-03-26 12:32:46 -07:00
Mayuri Nehate
ac9997d970
feat(ingest/snowflake): ingest stored procedures (#12929)
Co-authored-by: Sergio Gómez Villamor <sgomezvillamor@gmail.com>
2025-03-26 20:02:55 +05:30
Sergio Gómez Villamor
29d05c214a
feat(hex): warehouse integration via Query enrichment (#12949) 2025-03-26 09:35:50 +01:00
Sergio Gómez Villamor
5c58dbacce
feat(ingest): new hex connector - part 1 (#12915) 2025-03-25 19:47:11 +01:00
Harshal Sheth
7535583958
feat(ingest/mode): fix issue in mode request validation (#12948) 2025-03-25 08:03:40 -07:00
Mayuri Nehate
a3a1f50886
fix(ingest/dbt): consider dbt run results with success status (#12942) 2025-03-24 15:09:48 +05:30
ryota-cloud
9f8753bcb2
feat(ingestion) Adding vertexAI ingestion source (v2 - experiment and experiment run) (#12836) 2025-03-21 14:06:17 -07:00
Peter Wang
6914df3721
feat(ingestion/superset): add timeout values to config to prevent hanging queries from blocking ingestion (#12884) 2025-03-21 08:08:56 -07:00
Mayuri Nehate
8323bc3910
fix(ingest/dremio): simplify and fix build source map (#12908) 2025-03-21 11:31:16 +05:30
skrydal
1185ba8121
feat(ingestion/iceberg): Refactor iceberg source to use MCPWs instead of MCEs (#12912) 2025-03-20 10:46:08 +01:00
Austin SeungJun Park
41895fe24f
feat(ingest/s3): add table filtering (#12661) 2025-03-20 07:57:43 +01:00
Sergio Gómez Villamor
2aba2e3ed8
fix(powerbi): fixes direction of the dashboard-report lineage (#12881) 2025-03-19 12:25:42 +01:00
Gabe Lyons
ecd9ffd137
feat(openapi): Adding subtype for openapi source (#12873) 2025-03-18 12:35:46 -07:00
Peter Wang
cffc6d4693
feat(ingestion/superset): superset column level lineage (#12786) 2025-03-14 08:02:54 -07:00
Deepak Garg
eb17f80e8a
feat(ingest/hive): identify partition columns in hive tables (#12833) 2025-03-13 11:37:52 -07:00
ryota-cloud
0e62e8c77a
feat(ingestion) Adding vertexAI ingestion source (v1 - model group and model) (#12632) 2025-03-13 11:02:15 -07:00
Mayuri Nehate
f9d71d67a0
feat(ingest/salesforce): include formula in in field description (#12840) 2025-03-13 22:00:06 +05:30
Hyejin Yoon
86f4b805cf
feat(ingest/mlflow): update dpi to use edge for lineage (#12861) 2025-03-13 10:05:00 +09:00
Hyejin Yoon
8bf1f718da
feat(ingestion/mlflow): improve mlflow connector to pull run and experiments (#12587) 2025-03-11 07:55:48 +09:00
Peter Wang
48b6581f12
fix(ingest/superset): fixed iterate over int error for building urns (#12807)
Co-authored-by: Sergio Gómez Villamor <sgomezvillamor@gmail.com>
2025-03-07 15:41:27 -08:00
Harshal Sheth
55fbb71a53
fix(ingest/oracle): refresh golden files (#12818) 2025-03-07 12:38:39 -08:00
Jonny Dixon
fcabe88962
fix(ingestion/oracle): Improved foreign key handling (#11867)
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2025-03-06 14:32:03 +00:00
Jonny Dixon
a700448bad
feat(ingestion/business-glossary): Automatically generate predictable glossary term and node URNs when incompatible URL characters are specified in term and node names. (#12673) 2025-03-06 14:30:10 +00:00
Harshal Sheth
de60ca30e8
fix(ingest): enable fuzzy case resolution for oracle sql (#12778) 2025-03-05 10:28:29 -08:00