Aseem Bansal
|
2a75a981ca
|
chore(ci): upgrade ruff version (#13125)
|
2025-04-09 11:24:07 +05:30 |
|
Harshal Sheth
|
1fca9855ee
|
fix(ingest/snowflake): fix error on stored procs in non-SQL languages (#13127)
|
2025-04-08 17:00:56 -07:00 |
|
Sergio Gómez Villamor
|
5c7b8e10ce
|
fix(hex): filter out queries if non scheduled runs (#13126)
|
2025-04-08 20:55:28 +02:00 |
|
Sergio Gómez Villamor
|
7dd4f06e71
|
docs(hex): additional limitations (#13103)
|
2025-04-08 07:59:21 +02:00 |
|
Sergio Gómez Villamor
|
4e48e098dc
|
fix(ingestion): fixes missing platform instance aspect for DataFlow entitiy (#13080)
|
2025-04-06 08:19:47 +02:00 |
|
skrydal
|
38f1553315
|
feat(ingestion): Refactoring timestamping logic for WorkUnits + custom logic for Iceberg (#13030)
Co-authored-by: Sergio Gómez Villamor <sgomezvillamor@gmail.com>
|
2025-04-04 22:30:27 +02:00 |
|
Pedro Silva
|
a4b343cc82
|
fix(ingest/delta-lake): Bump delta-lake dependency (#12766)
Co-authored-by: Sergio Gómez Villamor <sgomezvillamor@gmail.com>
|
2025-04-04 12:19:13 -07:00 |
|
Tamas Nemeth
|
df119cea1a
|
fix(ingest/mlflow): Fix stateful ingestion setup (#13084)
|
2025-04-04 18:47:19 +02:00 |
|
Tamas Nemeth
|
250b100a93
|
doc(ingestion/s3): Document permissions requirements for s3 source (#12816)
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
|
2025-04-04 18:28:42 +02:00 |
|
Sergio Gómez Villamor
|
b37fa03846
|
chore: fixes SIM118 ruff rule (#13069)
|
2025-04-04 11:59:43 +02:00 |
|
Rasnar
|
38e240e916
|
feat(ingest/airflow): platform_instance support in Airflow plugin (#12751)
Co-authored-by: rasnar <11248833+Rasnar@users.noreply.github.com>
Co-authored-by: Sergio Gómez Villamor <sgomezvillamor@gmail.com>
|
2025-04-04 09:26:58 +02:00 |
|
Harshal Sheth
|
4d53df63a2
|
fix(ingest/sigma): include workspace names in report (#13055)
|
2025-04-03 09:09:44 -07:00 |
|
Sergio Gómez Villamor
|
d2bb33f7c5
|
feat(ingest): new hex connector - part 2 (#12985)
|
2025-04-03 12:44:37 +02:00 |
|
Peter Wang
|
719cc67cac
|
feat(ingest/superset): leverage threads for superset API calls (#13006)
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
|
2025-04-02 10:27:57 -07:00 |
|
skrydal
|
ff799c9370
|
feat(ingestion/iceberg): source lastModified from table metadata field (#13052)
|
2025-04-02 12:05:41 +02:00 |
|
Sergio Gómez Villamor
|
e072a42d03
|
feat(ingest): adds get_entities_v3 method to DataHubGraph (#13045)
|
2025-04-02 10:22:14 +02:00 |
|
Harshal Sheth
|
18aa1f076d
|
fix(ingest/trino): always use table properties fallback (#13048)
|
2025-04-01 15:35:23 -07:00 |
|
Kevin Karch
|
d75de77d6b
|
docs(ingest): clarify snowflake key language (#13050)
|
2025-04-01 14:59:51 -04:00 |
|
Hugo Hobson
|
b394ae6350
|
docs(ingest): make fail_safe_threshold config visable in docs (#13017)
|
2025-04-01 12:49:13 +01:00 |
|
Hugo Hobson
|
acc84c2459
|
fix(cli): stop deployment config being overwritten by cli defaults (#13036)
`executor_id` and `time_zone` values set in the `deployment` block of a recipe are not being used by `datahub ingest deploy` cli command when deploying recipes. This is because the [cli values take precedence over deployment config](https://github.com/datahub-project/datahub/blob/master/metadata-ingestion/src/datahub/utilities/ingest_utils.py#L63), so where the cli has default values these as always used.
Default values should be set in [`DeployOptions`](https://github.com/datahub-project/datahub/blob/master/metadata-ingestion/src/datahub/utilities/ingest_utils.py#L23), not in the cli options.
|
2025-04-01 10:21:30 +01:00 |
|
Sergio Gómez Villamor
|
c6acce9906
|
feat(powerbi): capture dataset report lineage (#12993)
|
2025-04-01 11:12:47 +02:00 |
|
ryota-cloud
|
ebea3b7ca3
|
fix(ingestion) create ExperimentKey instead of containerKeyId used in MLflow and Vertex AI (#12995)
|
2025-04-01 00:00:09 -07:00 |
|
Hyejin Yoon
|
9e28c1af63
|
docs(mlflow): add docs for the mlflow dataset config (#12973)
|
2025-04-01 12:20:32 +09:00 |
|
Harshal Sheth
|
c79192090d
|
feat(ingest): propagate backpressure in ThreadedIteratorExecutor (#13027)
|
2025-03-31 10:23:00 -07:00 |
|
Harshal Sheth
|
58169ad7cc
|
fix(sdk): fix bugs in v2 sdk search client (#13026)
|
2025-03-31 08:59:32 -07:00 |
|
Harshal Sheth
|
2ef0086394
|
feat(ingest): allow sources to produce sdk entities (#13028)
|
2025-03-31 08:33:17 -07:00 |
|
Gabe Lyons
|
ee4827e1b2
|
fix(oracle): fixing oracle CLL for view parsing. (#13029)
|
2025-03-30 07:42:55 -07:00 |
|
Chakru
|
d2dd54acf1
|
feat(dataset_cli): add dry-run support (#12814)
|
2025-03-29 18:08:52 +05:30 |
|
Harshal Sheth
|
3e4d14734b
|
feat(ingest/sigma): add reporting on filtered workspaces (#12998)
|
2025-03-28 16:58:34 -07:00 |
|
Harshal Sheth
|
5bc8a895f9
|
chore(ingest): remove calls to deprecated methods (#13009)
|
2025-03-28 13:42:54 -07:00 |
|
Harshal Sheth
|
716bf87f8f
|
fix(ingest): make emitter endpoint fully env-controlled (#13019)
|
2025-03-28 12:21:54 -07:00 |
|
Michael Minichino
|
8757a0e01a
|
feat(ingest/powerbi): PowerBI source updates (#12857)
|
2025-03-28 13:22:25 -05:00 |
|
skrydal
|
b7bb0b056c
|
feat(ingestion/iceberg): Refactor iceberg connector (#12921)
|
2025-03-28 18:34:36 +01:00 |
|
Aseem Bansal
|
d4812d7b05
|
fix(ingest/redshift): respect skip external table config (#13003)
|
2025-03-28 12:33:39 +05:30 |
|
Harshal Sheth
|
29e09185eb
|
fix(ingest): warn when API tracing is unexpectedly inactive (#13007)
|
2025-03-27 22:21:33 -07:00 |
|
Felix Lüdin
|
54fe8bbd8d
|
fix(ingest/powerbi): fix KeyError when ingesting apps from Power BI (#12975)
|
2025-03-27 13:42:15 -07:00 |
|
Harshal Sheth
|
f58febc040
|
feat(sdk): add FilterOperator enum to search sdk (#12997)
|
2025-03-27 11:09:56 -07:00 |
|
Mayuri Nehate
|
f9d6c9f1f9
|
docs(ingest/snowflake): update docs to capture key pair auth section (#13001)
|
2025-03-27 11:02:32 -07:00 |
|
Peter Wang
|
e0d805c8f7
|
feat(ingestion/superset): column level lineage for charts (#12930)
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
Co-authored-by: Jay <159848059+jayacryl@users.noreply.github.com>
Co-authored-by: Shuixi Li <llance@users.noreply.github.com>
Co-authored-by: Gabe Lyons <gabe.lyons@acryl.io>
Co-authored-by: Sergio Gómez Villamor <sgomezvillamor@gmail.com>
Co-authored-by: Chris Collins <chriscollins3456@gmail.com>
Co-authored-by: amit-apptware <132869468+amit-apptware@users.noreply.github.com>
Co-authored-by: Austin SeungJun Park <110667795+eagle-25@users.noreply.github.com>
Co-authored-by: skrydal <piotr.skrydalewicz@acryl.io>
Co-authored-by: Saketh Varma <sakethvarma397@gmail.com>
Co-authored-by: Dmitry Bryazgin <58312247+bda618@users.noreply.github.com>
Co-authored-by: Hyejin Yoon <0327jane@gmail.com>
Co-authored-by: John Joyce <john@acryl.io>
Co-authored-by: John Joyce <john@Mac.lan>
Co-authored-by: Chakru <161002324+chakru-r@users.noreply.github.com>
Co-authored-by: Mayuri Nehate <33225191+mayurinehate@users.noreply.github.com>
Co-authored-by: Maggie Hays <maggiem.hays@gmail.com>
Co-authored-by: Pedro Silva <pedro@acryl.io>
Co-authored-by: Gabe Lyons <itsgabelyons@gmail.com>
|
2025-03-27 08:05:54 -07:00 |
|
Sergio Gómez Villamor
|
6ab518faf8
|
feat(databricks): approx percentile for median (#12987)
|
2025-03-27 15:58:39 +01:00 |
|
Michael Minichino
|
ca695a7429
|
fix(ingest/redshift): resolve ingestion errors (#12992)
|
2025-03-27 07:52:44 -05:00 |
|
Mayuri Nehate
|
1bf395bf55
|
fix(ingest): split merge statements correctly (#12989)
|
2025-03-27 14:24:50 +05:30 |
|
Tamas Nemeth
|
a61a5856c0
|
fix(ingest/gc): Fix for slow soft-deleted entity deletion (#12931)
|
2025-03-27 09:43:48 +01:00 |
|
Hyejin Yoon
|
55cf62b49f
|
feat(ingest/mlflow): add mlflow auth config (#12984)
|
2025-03-27 11:30:30 +09:00 |
|
ryota-cloud
|
95be7eb185
|
fix(ingestion) Adding Vertex AI Connector documentation (#12967)
|
2025-03-26 16:37:34 -07:00 |
|
ryota-cloud
|
7cc0301fd5
|
fix(ingestion) Added externalURL of model group for Vertex AI (#12981)
|
2025-03-26 12:32:46 -07:00 |
|
Harshal Sheth
|
1d22c58e13
|
chore(ingest): use typing-aware deprecation type (#12982)
|
2025-03-26 11:32:46 -07:00 |
|
Mayuri Nehate
|
ac9997d970
|
feat(ingest/snowflake): ingest stored procedures (#12929)
Co-authored-by: Sergio Gómez Villamor <sgomezvillamor@gmail.com>
|
2025-03-26 20:02:55 +05:30 |
|
Sergio Gómez Villamor
|
29d05c214a
|
feat(hex): warehouse integration via Query enrichment (#12949)
|
2025-03-26 09:35:50 +01:00 |
|
Sergio Gómez Villamor
|
5c58dbacce
|
feat(ingest): new hex connector - part 1 (#12915)
|
2025-03-25 19:47:11 +01:00 |
|