4027 Commits

Author SHA1 Message Date
Chakru
d2dd54acf1
feat(dataset_cli): add dry-run support (#12814) 2025-03-29 18:08:52 +05:30
Harshal Sheth
3e4d14734b
feat(ingest/sigma): add reporting on filtered workspaces (#12998) 2025-03-28 16:58:34 -07:00
Harshal Sheth
5bc8a895f9
chore(ingest): remove calls to deprecated methods (#13009) 2025-03-28 13:42:54 -07:00
Harshal Sheth
716bf87f8f
fix(ingest): make emitter endpoint fully env-controlled (#13019) 2025-03-28 12:21:54 -07:00
Michael Minichino
8757a0e01a
feat(ingest/powerbi): PowerBI source updates (#12857) 2025-03-28 13:22:25 -05:00
skrydal
b7bb0b056c
feat(ingestion/iceberg): Refactor iceberg connector (#12921) 2025-03-28 18:34:36 +01:00
Aseem Bansal
d4812d7b05
fix(ingest/redshift): respect skip external table config (#13003) 2025-03-28 12:33:39 +05:30
Harshal Sheth
29e09185eb
fix(ingest): warn when API tracing is unexpectedly inactive (#13007) 2025-03-27 22:21:33 -07:00
Felix Lüdin
54fe8bbd8d
fix(ingest/powerbi): fix KeyError when ingesting apps from Power BI (#12975) 2025-03-27 13:42:15 -07:00
Harshal Sheth
f58febc040
feat(sdk): add FilterOperator enum to search sdk (#12997) 2025-03-27 11:09:56 -07:00
Mayuri Nehate
f9d6c9f1f9
docs(ingest/snowflake): update docs to capture key pair auth section (#13001) 2025-03-27 11:02:32 -07:00
Peter Wang
e0d805c8f7
feat(ingestion/superset): column level lineage for charts (#12930)
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
Co-authored-by: Jay <159848059+jayacryl@users.noreply.github.com>
Co-authored-by: Shuixi Li <llance@users.noreply.github.com>
Co-authored-by: Gabe Lyons <gabe.lyons@acryl.io>
Co-authored-by: Sergio Gómez Villamor <sgomezvillamor@gmail.com>
Co-authored-by: Chris Collins <chriscollins3456@gmail.com>
Co-authored-by: amit-apptware <132869468+amit-apptware@users.noreply.github.com>
Co-authored-by: Austin SeungJun Park <110667795+eagle-25@users.noreply.github.com>
Co-authored-by: skrydal <piotr.skrydalewicz@acryl.io>
Co-authored-by: Saketh Varma <sakethvarma397@gmail.com>
Co-authored-by: Dmitry Bryazgin <58312247+bda618@users.noreply.github.com>
Co-authored-by: Hyejin Yoon <0327jane@gmail.com>
Co-authored-by: John Joyce <john@acryl.io>
Co-authored-by: John Joyce <john@Mac.lan>
Co-authored-by: Chakru <161002324+chakru-r@users.noreply.github.com>
Co-authored-by: Mayuri Nehate <33225191+mayurinehate@users.noreply.github.com>
Co-authored-by: Maggie Hays <maggiem.hays@gmail.com>
Co-authored-by: Pedro Silva <pedro@acryl.io>
Co-authored-by: Gabe Lyons <itsgabelyons@gmail.com>
2025-03-27 08:05:54 -07:00
Sergio Gómez Villamor
6ab518faf8
feat(databricks): approx percentile for median (#12987) 2025-03-27 15:58:39 +01:00
Michael Minichino
ca695a7429
fix(ingest/redshift): resolve ingestion errors (#12992) 2025-03-27 07:52:44 -05:00
Mayuri Nehate
1bf395bf55
fix(ingest): split merge statements correctly (#12989) 2025-03-27 14:24:50 +05:30
Tamas Nemeth
a61a5856c0
fix(ingest/gc): Fix for slow soft-deleted entity deletion (#12931) 2025-03-27 09:43:48 +01:00
Hyejin Yoon
55cf62b49f
feat(ingest/mlflow): add mlflow auth config (#12984) 2025-03-27 11:30:30 +09:00
ryota-cloud
95be7eb185
fix(ingestion) Adding Vertex AI Connector documentation (#12967) 2025-03-26 16:37:34 -07:00
ryota-cloud
7cc0301fd5
fix(ingestion) Added externalURL of model group for Vertex AI (#12981) 2025-03-26 12:32:46 -07:00
Harshal Sheth
1d22c58e13
chore(ingest): use typing-aware deprecation type (#12982) 2025-03-26 11:32:46 -07:00
Mayuri Nehate
ac9997d970
feat(ingest/snowflake): ingest stored procedures (#12929)
Co-authored-by: Sergio Gómez Villamor <sgomezvillamor@gmail.com>
2025-03-26 20:02:55 +05:30
Sergio Gómez Villamor
29d05c214a
feat(hex): warehouse integration via Query enrichment (#12949) 2025-03-26 09:35:50 +01:00
Sergio Gómez Villamor
5c58dbacce
feat(ingest): new hex connector - part 1 (#12915) 2025-03-25 19:47:11 +01:00
Harshal Sheth
7535583958
feat(ingest/mode): fix issue in mode request validation (#12948) 2025-03-25 08:03:40 -07:00
Jay
bb8bf6ae7b
feat(ingestion) slack source v2 - now ingests all user and channels (#12795) 2025-03-24 21:19:42 -04:00
ryota-cloud
11353d1172
fix(metadata-ingestion) fix connector test error for Vertex AI (#12963) 2025-03-24 13:17:57 -07:00
Harshal Sheth
2cc8856c6b
feat(ingest): allow MCPWs instead of workunits (#12947) 2025-03-24 08:10:48 -07:00
Mayuri Nehate
a3a1f50886
fix(ingest/dbt): consider dbt run results with success status (#12942) 2025-03-24 15:09:48 +05:30
Günther Hackl
f48b8dd6c0
fix(ingestion): schema-metadata - fix jsonProps not being ingested for optional fields (#12927)
Co-authored-by: Sergio Gómez Villamor <sgomezvillamor@gmail.com>
2025-03-22 08:41:11 -07:00
Harshal Sheth
dd4aff2208
fix(cli): fix unknown aspect bug in dataset upsert cli (#12946) 2025-03-22 08:30:44 -07:00
Harshal Sheth
1d6c15edd3
docs(sdk): update some examples with the new SDK (#12933) 2025-03-21 16:00:05 -07:00
ryota-cloud
9f8753bcb2
feat(ingestion) Adding vertexAI ingestion source (v2 - experiment and experiment run) (#12836) 2025-03-21 14:06:17 -07:00
Harshal Sheth
fbd4c1e012
docs(sdk): add docstrings for some sdk classes (#12940) 2025-03-21 11:39:45 -07:00
Peter Wang
6914df3721
feat(ingestion/superset): add timeout values to config to prevent hanging queries from blocking ingestion (#12884) 2025-03-21 08:08:56 -07:00
Mayuri Nehate
8323bc3910
fix(ingest/dremio): simplify and fix build source map (#12908) 2025-03-21 11:31:16 +05:30
Hyejin Yoon
ac2a8e2ef0
feat(ingest/mlflow): add dataset lineage (#12837) 2025-03-21 08:38:43 +09:00
skrydal
1185ba8121
feat(ingestion/iceberg): Refactor iceberg source to use MCPWs instead of MCEs (#12912) 2025-03-20 10:46:08 +01:00
Austin SeungJun Park
41895fe24f
feat(ingest/s3): add table filtering (#12661) 2025-03-20 07:57:43 +01:00
Sergio Gómez Villamor
2aba2e3ed8
fix(powerbi): fixes direction of the dashboard-report lineage (#12881) 2025-03-19 12:25:42 +01:00
Gabe Lyons
ecd9ffd137
feat(openapi): Adding subtype for openapi source (#12873) 2025-03-18 12:35:46 -07:00
Shuixi Li
78f4852d55
fix(ingestion/superset): fixed changed_on_utc value being a string (#12883) 2025-03-17 17:46:14 -07:00
Harshal Sheth
85a5b5cea1
fix(ingest): pin lookml liquid dep (#12896) 2025-03-17 13:51:04 -07:00
Harshal Sheth
8fbc4d125f
fix(ingest): fix superset declared deps (#12889) 2025-03-17 10:29:02 -07:00
Peter Wang
cffc6d4693
feat(ingestion/superset): superset column level lineage (#12786) 2025-03-14 08:02:54 -07:00
Hyejin Yoon
669c67ad53
feat(docs/mlflow): update sample scripts to be compatible with edges/versioning (#12878) 2025-03-14 12:20:25 +09:00
ryota-cloud
106d7755d5
fix(ingest): fix formatting to resolve lint error (#12875) 2025-03-13 16:09:39 -07:00
skrydal
ba8932cdc2
fix(ingest/snowflake): Fixing table rename query handling (#12852) 2025-03-13 23:26:23 +01:00
Deepak Garg
eb17f80e8a
feat(ingest/hive): identify partition columns in hive tables (#12833) 2025-03-13 11:37:52 -07:00
ryota-cloud
0e62e8c77a
feat(ingestion) Adding vertexAI ingestion source (v1 - model group and model) (#12632) 2025-03-13 11:02:15 -07:00
david-leifker
ebd3a5078d
feat(ingestion-tracing): implement ingestion with tracing api (#12714) 2025-03-13 11:33:28 -05:00