Suman Maharana
5c8a0642fa
Minor: Add sql query for dbt lineage with nodes ( #21214 )
...
(cherry picked from commit 2864e0f09d188b5a382dd1d5153536688b7a9e36)
2025-05-15 12:20:57 +00:00
Suman Maharana
3e68352936
Chore Ingestion Tableau library change ( #21076 )
...
(cherry picked from commit f81ee52ec4942a206ed3ada581a67826384b548a)
2025-05-15 12:19:49 +00:00
IceS2
75b3d824a3
Fixes #21095 : Handle Conn Retry and implement is_disconnect for MSSQL ( #21185 )
...
* Handle Conn Retry and implement is_disconnect for MSSQL
* Change log to debug
(cherry picked from commit 87463df51df5691b3fd345659986e07067fb3ea5)
2025-05-15 10:21:14 +00:00
harshsoni2024
a0195a82a5
issue-20737: datalake parquet different extensions ( #21048 )
2025-05-15 10:43:23 +05:30
harshsoni2024
0a8421d11f
MINOR: parquet endpoint null case error ( #21015 )
2025-05-15 10:43:13 +05:30
Keshav Mohta
80466076da
fix: bigquery root= in connection
2025-05-15 01:21:56 +05:30
Mayur Singal
6ad2f3dcc7
MINOR: Handle udf definition fetch exceptions ( #21188 )
...
(cherry picked from commit 7abbb73ae23ce280c9818b110da10c325d8e6cae)
2025-05-14 18:32:19 +00:00
Suman Maharana
54dd779e8f
Fix #21030 - Snowflake Tags Not Reattached ( #21141 )
2025-05-14 16:52:51 +05:30
Mayur Singal
7aeff171f7
Fix #1552 : Improve Fetch Oracle View Definition Query ( #21177 )
...
(cherry picked from commit 618897be85f1e0ae76ea0aa52c42135de65db645)
2025-05-14 10:19:54 +00:00
Teddy
83d2811c07
MINOR: data sample ingestion bigquery ( #21074 )
...
* fix: data sample ingestion bigquery
* style: ran python linting
* fix: flaky test in topology
(cherry picked from commit a853561d30fcab34796a06c0e75ec0bb4f20e1f4)
2025-05-06 14:00:00 +00:00
Mayur Singal
d7bdc1bdc4
Fix #20902 : Fix duplicate constraints error ( #21037 )
...
(cherry picked from commit 9755662240a59a94a169cc02405042dee4fa7b88)
2025-04-30 06:05:45 +00:00
harshsoni2024
01b3a58f37
pbi dashboard sourceurl fix ( #21026 )
2025-04-30 10:29:58 +05:30
Mayur Singal
1179bc57b0
Fix #20024 : Fix get schema names logic for postgres ( #21036 )
...
(cherry picked from commit b3caf5b5d1bd236bbac87fe88c6438e32a2abdef)
2025-04-29 17:20:47 +00:00
Pere Miquel Brull
d5bfd47b0f
Merge branch '1.7.1' of github.com:open-metadata/OpenMetadata into 1.7.1
2025-04-29 09:54:37 +02:00
Pere Miquel Brull
10b408db75
FIX #16284 - Toggle if we want to raise workflow errors ( #20969 )
...
* FIX #16284 - Toggle if we want to raise workflow errors
* schema
* schema
* move prop
* fix
* move prop
* improve error handling
* Update openmetadata-service/src/main/java/org/openmetadata/service/jdbi3/IngestionPipelineRepository.java
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
* Update openmetadata-service/src/main/java/org/openmetadata/service/jdbi3/IngestionPipelineRepository.java
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
* Add the `Raise on Error` option to the ingestion schedule step
* Revert "Update openmetadata-service/src/main/java/org/openmetadata/service/jdbi3/IngestionPipelineRepository.java"
This reverts commit 985b73513a59695c6bb39ad41c2d273bbf4e5d22.
* Update the tests
* Fix sonar issue
---------
Co-authored-by: Aniket Katkar <aniketkatkar97@gmail.com>
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
2025-04-29 09:54:08 +02:00
Keshav Mohta
04aa358ec9
fix: service connection config not getting updated with multiple project ids after ingestion ( #20975 )
2025-04-28 10:05:54 +05:30
Keshav Mohta
1eb83c2bde
fix: string type as get system datatype ( #20922 )
2025-04-24 16:20:45 +05:30
github-actions
4731d6be77
chore(release): Prepare Branch for 1.7.1
2025-04-24 11:32:30 +05:30
github-actions
c2e7667f95
chore(release): Prepare Branch for 1.7.0
2025-04-24 11:32:27 +05:30
Ashish Gupta
73aaa34b75
update the snapshot to 1.8.0 ( #20925 )
2025-04-24 10:46:36 +05:30
Teddy
75b7e463be
ISSUE #19175 : Handle pk for snowflake in data diff ( #19734 )
...
* fix: handle pk for snowflake in data diff
* fix: trino failure
2025-04-23 12:15:42 +02:00
harshsoni2024
0d4e9e0e09
MINOR: REST minor fixes ( #20907 )
2025-04-22 15:10:15 +05:30
Keshav Mohta
1063e019ba
Fixes: Bigquery E2E ( #20863 )
2025-04-17 11:43:14 +05:30
Mayur Singal
88d8553084
Revert "MINOR: Improve UDF Lineage Processing & Better Logging Time & MultiProcessing ( #20848 )" ( #20872 )
...
This reverts commit 5ea9f22492749867f9ea53465b817f52bd383ca2.
2025-04-17 00:35:56 +05:30
Mayur Singal
5ea9f22492
MINOR: Improve UDF Lineage Processing & Better Logging Time & MultiProcessing ( #20848 )
2025-04-17 00:09:52 +05:30
Sasha Malahov
105ba064a9
MINOR: Kinesis missing nexttoken
2025-04-16 18:57:31 +05:30
Mayur Singal
654529ab7a
MINOR: Suppress Pydantic Warnings ( #20851 )
2025-04-16 16:44:14 +05:30
Akash Jain
0f6d0523d8
feat: Bump Versions to 1.7.0-SNAPSHOT on Main Branch ( #20847 )
...
* feat: Bump Versions to 1.7.0-SNAPSHOT on Main Branch
* fix(script): Add a condition for "-SNAPSHOT" is version update script
2025-04-16 15:21:01 +05:30
harshsoni2024
fb5af8ad7c
bigquery lib fix ( #20849 )
2025-04-16 08:04:26 +02:00
Keshav Mohta
1a6224824b
Fixes: BQ Multiple Project E2E ( #20797 )
...
* fix: bq e2e lineage and counts
* fix: bigquery multiple project classify
* fix: tests count from 19 to 17
2025-04-15 17:35:22 +05:30
Teddy
1edeb0baf8
MINOR: classification + test workflow for BQ multiproject ( #20779 )
...
* fix: classification + test workflow for BQ multiproject
* fix: deleted e2e test as handled from the UI
* fix: failing test case
2025-04-15 10:37:29 +02:00
Mayur Singal
3e4b8f5293
MINOR: Fix 'lr_sqlparser' referenced before assignment ( #20823 )
2025-04-15 13:00:04 +05:30
Mayur Singal
40ab1814c0
MINOR: Always Include DDL for Views ( #20784 )
2025-04-15 12:59:50 +05:30
Mayur Singal
56d3c335a7
MINOR: Fix pydantic warnings in ingestion ( #20822 )
...
* MINOR: Fix pydantic warnings in ingestion
* pydantic fix
2025-04-15 06:59:05 +02:00
chrisrayrayne
b14f83940a
Fixes Issue 20189: REST connector checks updated ( #20736 )
2025-04-15 10:24:57 +05:30
Suman Maharana
4dd94516e7
Fix : Dashboard OverrideMetadata ( #20793 )
2025-04-14 12:07:02 +05:30
Pere Miquel Brull
6d02ed8b5c
MINOR - Fix py checkstyle ( #20789 )
...
* MINOR - Fix py checkstyle
* dummy commit
2025-04-13 11:58:52 +02:00
Pere Miquel Brull
c38209c63b
FIX CL-#1427 - PATCH applies inherited owners ( #20759 )
...
* FIX CL-#1427 - PATCH applies inherited owners
* FIX CL-#1427 - PATCH applies inherited owners
* format
2025-04-13 06:56:33 +02:00
Sasha Malahov
6dac3550ba
fix(ingestion): Correct Topic import in Kinesis source ( #20787 )
...
This PR fixes a bug in the Kinesis messaging source where the `Topic` class was incorrectly imported from `metadata.generated.schema.type.schema` instead of the correct entity
definition path `metadata.generated.schema.entity.data.topic`.
**Problem:**
The `yield_topic_sample_data` method used the `type.schema.Topic` definition when calling `fqn.build` and `metadata.get_by_name`. These functions expect the main entity
class.
**Fix:**
Changed the import statement to use `metadata.generated.schema.entity.data.topic.Topic`.
This ensures the correct type definition is used when interacting with the FQN utility and metadata API, preventing potential downstream issues.
2025-04-13 06:38:07 +02:00
Akash Verma
5cbe9badef
Wherescape Connector ( #20500 )
...
* omd side ws connector files
* Removed files
* add beta tag
* update enum name
* rename connection to databaseConnection
* Revert "rename connection to databaseConnection"
This reverts commit 9f1bc74e7aa6c156bedb8eefeb1a5435fcf72319.
* rename from connection to metastore
* rename connection to dbconnection
* UI Generated files
* fix connector UI
* fix connector UI
---------
Co-authored-by: Akash Verma <akashverma@Akashs-MacBook-Pro-2.local>
Co-authored-by: ulixius9 <mayursingal9@gmail.com>
Co-authored-by: Sweta Agarwalla <swetaagarwalla13@gmail.com>
2025-04-11 18:04:58 +05:30
Keshav Mohta
d65a05e865
fix: added metadata in snowflake get_ometa_tag_and_classification ( #20719 )
2025-04-09 18:00:12 +05:30
Imri Paran
a0d631b7cb
chore: more linient pinning for python neo4j ( #20722 )
2025-04-09 09:05:44 +00:00
Keshav Mohta
18d6701429
Fixes: Snowflake Tags Ingestion ( #20710 )
2025-04-09 07:12:22 +02:00
Pere Miquel Brull
bcde18b387
DEPRECATE - Remove support for Python 3.8 ( #20553 )
2025-04-08 07:36:07 +02:00
Mayur Singal
4a407f6d0d
MINOR: Implement column validation in lineage patch api ( #20545 )
2025-04-07 21:24:46 +05:30
Pere Miquel Brull
3186937cc2
MINOR - Update Auto Classification defaults for sample data & classif… ( #20587 )
...
* MINOR - Update Auto Classification defaults for sample data & classification
* fix tests
2025-04-07 15:56:57 +02:00
Mayur Singal
b7d43e7ee2
MINOR: Improve threading for lineage ( #20668 )
2025-04-07 18:31:52 +05:30
Mohit Tilala
f7c4cc54f4
Revert "Fixes #20649 : removed memory leak in Redshift ingestion ( #20650 )" ( #20667 )
...
This reverts commit 6c725278e3e7bd5cb5f492108fa27dc8f9487f82.
2025-04-07 18:16:50 +05:30
Mayur Singal
ee5d8eee8b
Revert "MINOR: Implement Column Validation in Lineage ( #20544 )" ( #20658 )
2025-04-07 17:13:35 +05:30
Keshav Mohta
0796c6274b
Fixes: Databricks httpPath Required ( #20611 )
...
* fix: made databricks httpPath required and added a migration file for the same
* fix: added sql migration in postDataMigration file and fix databricks tests
* fix: added httpPath in test_source_connection.py and test_source_parsing.py files
* fix: added httpPath in test_databricks_lineage.py
* fix: table name in postgres migration
2025-04-07 13:33:55 +05:30