12076 Commits

Author SHA1 Message Date
Pedro Silva
f8f2fc1b60
feat(docs): Add environment variables for OSS 1.0.0 (#12894)
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2025-04-03 09:13:11 -07:00
Harshal Sheth
4d53df63a2
fix(ingest/sigma): include workspace names in report (#13055) 2025-04-03 09:09:44 -07:00
dependabot[bot]
c5aa6cb56a
build(deps): bump prismjs from 1.29.0 to 1.30.0 in /docs-website (#12849)
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2025-04-03 10:29:33 -05:00
dependabot[bot]
ebc02f8f83
chore(deps): bump tar-fs from 2.1.1 to 2.1.2 in /docs-website (#13023)
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2025-04-03 10:29:18 -05:00
dependabot[bot]
9dafe1bd02
build(deps): bump image-size from 1.1.1 to 1.2.1 in /docs-website (#13059)
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2025-04-03 10:29:01 -05:00
Sergio Gómez Villamor
d2bb33f7c5
feat(ingest): new hex connector - part 2 (#12985) 2025-04-03 12:44:37 +02:00
Nate Bryant
7618af549c
fix(logging): fixes slow query logging formatting and adds parsing fo… (#12955)
Co-authored-by: RyanHolstien <RyanHolstien@users.noreply.github.com>
2025-04-02 15:10:46 -05:00
Andrew Sikowitz
90666ef0f5
refactor(ui/v2): Update icons and search bars on schema tab, glossary search, domain search (#12740) 2025-04-02 12:16:50 -07:00
david-leifker
a1096e615a
fix(test): improve test stability (#13062) 2025-04-02 13:46:52 -05:00
Anna Everhart
156d4de375
refactor(ui): Updated Sidebar for Glossary and Domains to have same styling and fixed count badge (#13018) 2025-04-02 11:03:23 -07:00
Peter Wang
719cc67cac
feat(ingest/superset): leverage threads for superset API calls (#13006)
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2025-04-02 10:27:57 -07:00
Kevin Karch
cd05c0f2fe
docs(ingest): more specific CLL limitation language (#13061) 2025-04-02 13:12:25 -04:00
david-leifker
f11d7f9287
refactor(auth-filter): refactor exception and logging (#13035) 2025-04-02 12:00:41 -05:00
david-leifker
1e6db0680a
fix(openapi): restore openapi v3 aspect version endpoint (#13047) 2025-04-02 09:15:34 -05:00
Saketh Varma
9071d67545
fix(ci): Avoid meticulous steps on fork PRs (#13051) 2025-04-02 11:01:03 -03:00
skrydal
ff799c9370
feat(ingestion/iceberg): source lastModified from table metadata field (#13052) 2025-04-02 12:05:41 +02:00
Sergio Gómez Villamor
e072a42d03
feat(ingest): adds get_entities_v3 method to DataHubGraph (#13045) 2025-04-02 10:22:14 +02:00
Chakru
40106be208
build: optimizations for incremental builds and faster CI (#13033)
Co-authored-by: Andrew Sikowitz <andrew.sikowitz@acryl.io>
2025-04-02 11:51:10 +05:30
John Joyce
87af4b9d53
refactor(): Fix incidents feedback on QA (#13044)
Co-authored-by: Aseem Bansal <asmbansal2@gmail.com>
Co-authored-by: John Joyce <john@Mac-307.lan>
2025-04-01 17:22:41 -07:00
Harshal Sheth
18aa1f076d
fix(ingest/trino): always use table properties fallback (#13048) 2025-04-01 15:35:23 -07:00
Andrew Sikowitz
cc5ce6f19c
fix(ui/lineageV2): Convert toggle to hide data process instances instead of show (#13022) 2025-04-01 13:59:22 -07:00
Andrew Sikowitz
3132ca7c0c
test(metadata-io/graph-service): Update lineage registry creation for dgraph and neo4j tests (#13037) 2025-04-01 15:09:52 -05:00
Kevin Karch
d75de77d6b
docs(ingest): clarify snowflake key language (#13050) 2025-04-01 14:59:51 -04:00
Hugo Hobson
b394ae6350
docs(ingest): make fail_safe_threshold config visable in docs (#13017) 2025-04-01 12:49:13 +01:00
Hugo Hobson
acc84c2459
fix(cli): stop deployment config being overwritten by cli defaults (#13036)
`executor_id` and `time_zone` values set in the `deployment` block of a recipe are not being used by `datahub ingest deploy` cli command when deploying recipes. This is because the [cli values take precedence over deployment config](https://github.com/datahub-project/datahub/blob/master/metadata-ingestion/src/datahub/utilities/ingest_utils.py#L63), so where the cli has default values these as always used.

Default values should be set in [`DeployOptions`](https://github.com/datahub-project/datahub/blob/master/metadata-ingestion/src/datahub/utilities/ingest_utils.py#L23), not in the cli options.
2025-04-01 10:21:30 +01:00
Sergio Gómez Villamor
c6acce9906
feat(powerbi): capture dataset report lineage (#12993) 2025-04-01 11:12:47 +02:00
ryota-cloud
ebea3b7ca3
fix(ingestion) create ExperimentKey instead of containerKeyId used in MLflow and Vertex AI (#12995) 2025-04-01 00:00:09 -07:00
ryota-cloud
b5af0084cb
fix(ui) fix subtype name of datajob on dataflow card (#13021)
Co-authored-by: Hyejin Yoon <0327jane@gmail.com>
2025-03-31 23:59:19 -07:00
Hyejin Yoon
9e28c1af63
docs(mlflow): add docs for the mlflow dataset config (#12973) 2025-04-01 12:20:32 +09:00
ryota-cloud
b6af240e97
fix(ui) remove SQL from TaskIcon for Vertex AI Pipeline task (#13024)
Co-authored-by: Andrew Sikowitz <andrew.sikowitz@acryl.io>
2025-03-31 18:16:20 -07:00
Harshal Sheth
e7033e4d89
docs: hide rc releases from autogenerated docs (#13040) 2025-03-31 15:31:15 -07:00
John Joyce
00edc4205f
feat(Tags): Support Managing Tags via "Manage Tags" nav bar page (V1) (#12983)
Co-authored-by: Annadoesdesign <annaerocca@gmail.com>
Co-authored-by: Anna Everhart <149417426+annadoesdesign@users.noreply.github.com>
Co-authored-by: John Joyce <john@ip-192-168-1-64.us-west-2.compute.internal>
Co-authored-by: John Joyce <john@Mac.lan>
Co-authored-by: amit-apptware <132869468+amit-apptware@users.noreply.github.com>
Co-authored-by: John Joyce <john@Mac-302.lan>
2025-03-31 15:30:51 -07:00
Harshal Sheth
c2ca0c28c2
fix(ui): fix hex logo filename (#13041) 2025-03-31 15:28:09 -07:00
Harshal Sheth
c79192090d
feat(ingest): propagate backpressure in ThreadedIteratorExecutor (#13027) 2025-03-31 10:23:00 -07:00
Harshal Sheth
58169ad7cc
fix(sdk): fix bugs in v2 sdk search client (#13026) 2025-03-31 08:59:32 -07:00
Anna Everhart
dcfc5e6f15
refactor(ui): Updated entitysidebar tabs to have the same styling as the redesigned… (#12917) 2025-03-31 08:58:01 -07:00
Harshal Sheth
2ef0086394
feat(ingest): allow sources to produce sdk entities (#13028) 2025-03-31 08:33:17 -07:00
Aseem Bansal
68b4fcb054
fix(ingest): add mutator for ownership types (#13002) 2025-03-31 15:43:38 +05:30
Gabe Lyons
ee4827e1b2
fix(oracle): fixing oracle CLL for view parsing. (#13029) 2025-03-30 07:42:55 -07:00
Chakru
04a8e305a2
fix(lineage): lineage incorrect for some entities (#13020) 2025-03-30 19:01:19 +05:30
Chakru
d2dd54acf1
feat(dataset_cli): add dry-run support (#12814) 2025-03-29 18:08:52 +05:30
Harshal Sheth
3e4d14734b
feat(ingest/sigma): add reporting on filtered workspaces (#12998) 2025-03-28 16:58:34 -07:00
david-leifker
a37a1a502e
fix(system-update): make buildIndices first step (#13015) 2025-03-28 18:11:53 -05:00
david-leifker
fa80c8dbfe
refactor(): use static yaml mapper es search service (#13016) 2025-03-28 17:47:28 -05:00
Andrew Sikowitz
a846f9d92d
fix(ui/lineageV2): Fix bug with not getting all lineage nodes when hiding transformations (#13005) 2025-03-28 14:56:36 -07:00
Harshal Sheth
5bc8a895f9
chore(ingest): remove calls to deprecated methods (#13009) 2025-03-28 13:42:54 -07:00
Harshal Sheth
d3ef859802
fix(airflow): drop airflow 2.3 and 2.4 support (#13004) 2025-03-28 12:58:50 -07:00
Harshal Sheth
716bf87f8f
fix(ingest): make emitter endpoint fully env-controlled (#13019) 2025-03-28 12:21:54 -07:00
amit-apptware
5ea572aac5
Feat(ui/incident-v2) : Added smoke test and unit test cases for sibling create incidents (#12953) 2025-03-28 11:41:18 -07:00
Michael Minichino
8757a0e01a
feat(ingest/powerbi): PowerBI source updates (#12857) 2025-03-28 13:22:25 -05:00