3285 Commits

Author SHA1 Message Date
Suman Maharana
5c8a0642fa Minor: Add sql query for dbt lineage with nodes (#21214)
(cherry picked from commit 2864e0f09d188b5a382dd1d5153536688b7a9e36)
2025-05-15 12:20:57 +00:00
Suman Maharana
3e68352936 Chore Ingestion Tableau library change (#21076)
(cherry picked from commit f81ee52ec4942a206ed3ada581a67826384b548a)
2025-05-15 12:19:49 +00:00
IceS2
75b3d824a3 Fixes #21095: Handle Conn Retry and implement is_disconnect for MSSQL (#21185)
* Handle Conn Retry and implement is_disconnect for MSSQL

* Change log to debug

(cherry picked from commit 87463df51df5691b3fd345659986e07067fb3ea5)
2025-05-15 10:21:14 +00:00
harshsoni2024
a0195a82a5 issue-20737: datalake parquet different extensions (#21048) 2025-05-15 10:43:23 +05:30
harshsoni2024
0a8421d11f MINOR: parquet endpoint null case error (#21015) 2025-05-15 10:43:13 +05:30
Keshav Mohta
80466076da
fix: bigquery root= in connection 2025-05-15 01:21:56 +05:30
Mayur Singal
6ad2f3dcc7 MINOR: Handle udf definition fetch exceptions (#21188)
(cherry picked from commit 7abbb73ae23ce280c9818b110da10c325d8e6cae)
2025-05-14 18:32:19 +00:00
Suman Maharana
54dd779e8f Fix #21030 - Snowflake Tags Not Reattached (#21141) 2025-05-14 16:52:51 +05:30
Mayur Singal
7aeff171f7 Fix #1552: Improve Fetch Oracle View Definition Query (#21177)
(cherry picked from commit 618897be85f1e0ae76ea0aa52c42135de65db645)
2025-05-14 10:19:54 +00:00
Teddy
83d2811c07 MINOR: data sample ingestion bigquery (#21074)
* fix: data sample ingestion bigquery

* style: ran python linting

* fix: flaky test in topology

(cherry picked from commit a853561d30fcab34796a06c0e75ec0bb4f20e1f4)
2025-05-06 14:00:00 +00:00
Mayur Singal
d7bdc1bdc4 Fix #20902: Fix duplicate constraints error (#21037)
(cherry picked from commit 9755662240a59a94a169cc02405042dee4fa7b88)
2025-04-30 06:05:45 +00:00
harshsoni2024
01b3a58f37 pbi dashboard sourceurl fix (#21026) 2025-04-30 10:29:58 +05:30
Mayur Singal
1179bc57b0 Fix #20024: Fix get schema names logic for postgres (#21036)
(cherry picked from commit b3caf5b5d1bd236bbac87fe88c6438e32a2abdef)
2025-04-29 17:20:47 +00:00
Pere Miquel Brull
d5bfd47b0f Merge branch '1.7.1' of github.com:open-metadata/OpenMetadata into 1.7.1 2025-04-29 09:54:37 +02:00
Pere Miquel Brull
10b408db75 FIX #16284 - Toggle if we want to raise workflow errors (#20969)
* FIX #16284 - Toggle if we want to raise workflow errors

* schema

* schema

* move prop

* fix

* move prop

* improve error handling

* Update openmetadata-service/src/main/java/org/openmetadata/service/jdbi3/IngestionPipelineRepository.java

Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>

* Update openmetadata-service/src/main/java/org/openmetadata/service/jdbi3/IngestionPipelineRepository.java

Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>

* Add the `Raise on Error` option to the ingestion schedule step

* Revert "Update openmetadata-service/src/main/java/org/openmetadata/service/jdbi3/IngestionPipelineRepository.java"

This reverts commit 985b73513a59695c6bb39ad41c2d273bbf4e5d22.

* Update the tests

* Fix sonar issue

---------

Co-authored-by: Aniket Katkar <aniketkatkar97@gmail.com>
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
2025-04-29 09:54:08 +02:00
Keshav Mohta
04aa358ec9
fix: service connection config not getting updated with multiple project ids after ingestion (#20975) 2025-04-28 10:05:54 +05:30
Keshav Mohta
1eb83c2bde
fix: string type as get system datatype (#20922) 2025-04-24 16:20:45 +05:30
github-actions
4731d6be77 chore(release): Prepare Branch for 1.7.1 2025-04-24 11:32:30 +05:30
github-actions
c2e7667f95 chore(release): Prepare Branch for 1.7.0 2025-04-24 11:32:27 +05:30
Ashish Gupta
73aaa34b75
update the snapshot to 1.8.0 (#20925) 2025-04-24 10:46:36 +05:30
Teddy
75b7e463be
ISSUE #19175: Handle pk for snowflake in data diff (#19734)
* fix: handle pk for snowflake in data diff

* fix: trino failure
2025-04-23 12:15:42 +02:00
harshsoni2024
0d4e9e0e09
MINOR: REST minor fixes (#20907) 2025-04-22 15:10:15 +05:30
Keshav Mohta
1063e019ba
Fixes: Bigquery E2E (#20863) 2025-04-17 11:43:14 +05:30
Mayur Singal
88d8553084
Revert "MINOR: Improve UDF Lineage Processing & Better Logging Time & MultiProcessing (#20848)" (#20872)
This reverts commit 5ea9f22492749867f9ea53465b817f52bd383ca2.
2025-04-17 00:35:56 +05:30
Mayur Singal
5ea9f22492
MINOR: Improve UDF Lineage Processing & Better Logging Time & MultiProcessing (#20848) 2025-04-17 00:09:52 +05:30
Sasha Malahov
105ba064a9
MINOR: Kinesis missing nexttoken 2025-04-16 18:57:31 +05:30
Mayur Singal
654529ab7a
MINOR: Suppress Pydantic Warnings (#20851) 2025-04-16 16:44:14 +05:30
Akash Jain
0f6d0523d8
feat: Bump Versions to 1.7.0-SNAPSHOT on Main Branch (#20847)
* feat: Bump Versions to 1.7.0-SNAPSHOT on Main Branch

* fix(script): Add a condition for "-SNAPSHOT" is version update script
2025-04-16 15:21:01 +05:30
harshsoni2024
fb5af8ad7c
bigquery lib fix (#20849) 2025-04-16 08:04:26 +02:00
Keshav Mohta
1a6224824b
Fixes: BQ Multiple Project E2E (#20797)
* fix: bq e2e lineage and counts

* fix: bigquery multiple project classify

* fix: tests count from 19 to 17
2025-04-15 17:35:22 +05:30
Teddy
1edeb0baf8
MINOR: classification + test workflow for BQ multiproject (#20779)
* fix: classification + test workflow for BQ multiproject

* fix: deleted e2e test as handled from the UI

* fix: failing test case
2025-04-15 10:37:29 +02:00
Mayur Singal
3e4b8f5293
MINOR: Fix 'lr_sqlparser' referenced before assignment (#20823) 2025-04-15 13:00:04 +05:30
Mayur Singal
40ab1814c0
MINOR: Always Include DDL for Views (#20784) 2025-04-15 12:59:50 +05:30
Mayur Singal
56d3c335a7
MINOR: Fix pydantic warnings in ingestion (#20822)
* MINOR: Fix pydantic warnings in ingestion

* pydantic fix
2025-04-15 06:59:05 +02:00
chrisrayrayne
b14f83940a
Fixes Issue 20189: REST connector checks updated (#20736) 2025-04-15 10:24:57 +05:30
Suman Maharana
4dd94516e7
Fix : Dashboard OverrideMetadata (#20793) 2025-04-14 12:07:02 +05:30
Pere Miquel Brull
6d02ed8b5c
MINOR - Fix py checkstyle (#20789)
* MINOR - Fix py checkstyle

* dummy commit
2025-04-13 11:58:52 +02:00
Pere Miquel Brull
c38209c63b
FIX CL-#1427 - PATCH applies inherited owners (#20759)
* FIX CL-#1427 - PATCH applies inherited owners

* FIX CL-#1427 - PATCH applies inherited owners

* format
2025-04-13 06:56:33 +02:00
Sasha Malahov
6dac3550ba
fix(ingestion): Correct Topic import in Kinesis source (#20787)
This PR fixes a bug in the Kinesis messaging source where the `Topic` class was incorrectly imported from `metadata.generated.schema.type.schema` instead of the correct entity
  definition path `metadata.generated.schema.entity.data.topic`.

  **Problem:**
  The `yield_topic_sample_data` method used the `type.schema.Topic` definition when calling `fqn.build` and `metadata.get_by_name`. These functions expect the main entity
  class.

  **Fix:**
  Changed the import statement to use `metadata.generated.schema.entity.data.topic.Topic`.

  This ensures the correct type definition is used when interacting with the FQN utility and metadata API, preventing potential downstream issues.
2025-04-13 06:38:07 +02:00
Akash Verma
5cbe9badef
Wherescape Connector (#20500)
* omd side ws connector files

* Removed files

* add beta tag

* update enum name

* rename connection to databaseConnection

* Revert "rename connection to databaseConnection"

This reverts commit 9f1bc74e7aa6c156bedb8eefeb1a5435fcf72319.

* rename from connection to metastore

* rename connection to dbconnection

* UI Generated files

* fix connector UI

* fix connector UI

---------

Co-authored-by: Akash Verma <akashverma@Akashs-MacBook-Pro-2.local>
Co-authored-by: ulixius9 <mayursingal9@gmail.com>
Co-authored-by: Sweta Agarwalla <swetaagarwalla13@gmail.com>
2025-04-11 18:04:58 +05:30
Keshav Mohta
d65a05e865
fix: added metadata in snowflake get_ometa_tag_and_classification (#20719) 2025-04-09 18:00:12 +05:30
Imri Paran
a0d631b7cb
chore: more linient pinning for python neo4j (#20722) 2025-04-09 09:05:44 +00:00
Keshav Mohta
18d6701429
Fixes: Snowflake Tags Ingestion (#20710) 2025-04-09 07:12:22 +02:00
Pere Miquel Brull
bcde18b387
DEPRECATE - Remove support for Python 3.8 (#20553) 2025-04-08 07:36:07 +02:00
Mayur Singal
4a407f6d0d
MINOR: Implement column validation in lineage patch api (#20545) 2025-04-07 21:24:46 +05:30
Pere Miquel Brull
3186937cc2
MINOR - Update Auto Classification defaults for sample data & classif… (#20587)
* MINOR - Update Auto Classification defaults for sample data & classification

* fix tests
2025-04-07 15:56:57 +02:00
Mayur Singal
b7d43e7ee2
MINOR: Improve threading for lineage (#20668) 2025-04-07 18:31:52 +05:30
Mohit Tilala
f7c4cc54f4
Revert "Fixes #20649: removed memory leak in Redshift ingestion (#20650)" (#20667)
This reverts commit 6c725278e3e7bd5cb5f492108fa27dc8f9487f82.
2025-04-07 18:16:50 +05:30
Mayur Singal
ee5d8eee8b
Revert "MINOR: Implement Column Validation in Lineage (#20544)" (#20658) 2025-04-07 17:13:35 +05:30
Keshav Mohta
0796c6274b
Fixes: Databricks httpPath Required (#20611)
* fix: made databricks httpPath required and added a migration file for the same

* fix: added sql migration in postDataMigration file and fix databricks tests

* fix: added httpPath in test_source_connection.py and test_source_parsing.py files

* fix: added httpPath in test_databricks_lineage.py

* fix: table name in postgres migration
2025-04-07 13:33:55 +05:30