14126 Commits

Author SHA1 Message Date
IceS2
00776b05be
Merge branch 'main' into feature/dimensionality-for-data-quality 2025-10-14 17:28:51 +02:00
Bhanu Agrawal
650627a025
fix(nlq): Use dual-field search for owner queries to improve match rates (#23794) 2025-10-14 20:31:04 +05:30
Pablo Takara
15a33b7e1e
Merge branch 'feature/dimensionality-for-data-quality' of github.com:open-metadata/OpenMetadata into feature/dimensionality-for-data-quality 2025-10-14 16:50:43 +02:00
Pablo Takara
926f8457d0
Implement PR comments, fix Tests 2025-10-14 16:50:00 +02:00
Ushran Gouhar
582f9322ab
Potential fix for code scanning alert no. 1685: Incomplete string escaping or encoding (#23885)
Co-authored-by: Copilot Autofix powered by AI <62310815+github-advanced-security[bot]@users.noreply.github.com>
2025-10-14 18:07:31 +05:30
Shailesh Parmar
a7b54fed00
playwright: fix tier issue in playwright (#23883) 2025-10-14 18:02:12 +05:30
Sweta Agarwalla
dd307a43e0
fix(ui): Runner getting wrong values in workflow API (#23827)
* fix runner issues

* add unit tests for the fix
2025-10-14 17:13:55 +05:30
Ajith Prasad
f2a9dd0015
Fixes angus mail vulnerability issue (#23843) 2025-10-14 15:46:48 +05:30
Chirag Madlani
7a29bf1e2c
fix(test): customize details page and persona flow (#23839)
* fix(test): customize details page and persona flow

* revert playwright config
2025-10-14 15:27:21 +05:30
IceS2
7bdd9008ec
Fixes #23776 : Fix/data quality dashboard filtering (#23818)
* Fix Data Quality Dashboard Filtering

* Fix Data Quality Dashboard Filtering

* Fix Tier filter on DQ Dashboard

* Fix issue when tags are empty list

* Add Tier/Tag propagation to TestCaseResultIndex

* Add Tier/Tag propagation to TestCaseResultIndex

* Add Tier/Tag propagation to TestCaseResultIndex

* Add Tier/Tag propagation to TestCaseResultIndex

---------

Co-authored-by: Pere Miquel Brull <peremiquelbrull@gmail.com>
2025-10-14 11:30:10 +02:00
Mohit Tilala
09c851265e
[Redshift] Add better handling of incomplete redshift view definition (#23866)
* Add better handling of incomplete redshift view definition

* Match exact definitions in tests

* Correct isort on tests
2025-10-14 12:51:07 +05:30
Harsh Vador
a36eef1c84
Search refactoring updates (#23742)
* refactor searchQuery to avoid AND and OR operators

* fix searchQuery function

* fix serviceDetails.tsx

* refactor for searchQuery

* update searchData calls with searchQuery

* fix unit test

* refactor queryFilter for dataContractUtil.ts

* fix authProvider for global domain filter

* address PR comments

* revert dataProduct fqn change

* refactor all query filtersusing getTermQuery function

* fix test

* fix tests

* fix e2e tests

* fix test

* fix service listing

* fix test

* fix service spec

* fix glossary spec and tag spec

* fix domains spec

* fix tag spec

* fix failing specs

* fix failed specs

* fix failing tests

* fix domain spec

* fix classification & service listing spec

* change query filter for following & change message for no online users

* add missing followers field in entity index mapping

* add missing owners field in entity index mapping

* address comments

* fix failing test

---------

Co-authored-by: Pranita <pfulsundar8@gmail.com>
Co-authored-by: Akash Jain <15995028+akash-jain-10@users.noreply.github.com>
Co-authored-by: sonikashah <sonikashah94@gmail.com>
2025-10-14 10:30:52 +05:30
Sriharsha Chintalapani
949cc32eef
Fix user creation through openmetadata-ops.sh (#23879) 2025-10-14 09:19:17 +05:30
Harshit Shah
a3e5190f69
Playwright: Fix users.spec default persona test (#23820)
* Playwright: Fix users.spec default persona test

* minor fix

* minor fix

* minor fix
2025-10-13 21:03:07 +05:30
Keshav Mohta
50dbe6fe44
fix: view_names issue when incremental enabled (#23858) 2025-10-13 19:21:07 +05:30
IceS2
eb7dfdb28f
Fix #23849: search document update missing from incidents (#23861)
* Fix Data Quality Dashboard Filtering

* Fix Data Quality Dashboard Filtering

* Fix Tier filter on DQ Dashboard

* Fix issue when tags are empty list

* Add Tier/Tag propagation to TestCaseResultIndex

* Add Tier/Tag propagation to TestCaseResultIndex

* Add Tier/Tag propagation to TestCaseResultIndex

* Add Tier/Tag propagation to TestCaseResultIndex

* Fix Search Document Update missing from Incident PATH

* Fix Search Document Update for Incidents

* Revert unintended changes, keep only TestCaseResolutionStatusRepository fix
2025-10-13 15:18:38 +02:00
Ashish Gupta
73b4f77e2e
#23774 : fix the bulk import column name contains dot in it (#23791)
* fix the bulk import column name contains dot in it

* fix for name field

* fix the failing test

* fix the test failure
2025-10-13 17:43:21 +05:30
Mohit Yadav
8c02775b3b
Add Selective entity reindex for passed entity refs (#23828)
* Add Selective entity reindex for passed entity refs

* Add Timeouts

* Add admin check
2025-10-13 14:48:16 +05:30
Mayur Singal
a638bdcfe0
MINOR: Fix databricks pipeline repeating tasks issue (#23851) 2025-10-13 00:41:05 +05:30
Copilot
c8722faf47
Fix Grafana connector validation error for integer format fields (#23202)
* Initial plan

* Fix Grafana connector format field validation issue

- Update GrafanaTarget.format field to accept both str and int types
- Add field_validator to convert integer format codes to string equivalents
- Add comprehensive tests for format field validation scenarios
- Add test fixture with integer format fields that reproduces the original issue
- Ensure backwards compatibility with existing string format values

This resolves the issue where Grafana dashboards with integer format fields
(e.g., format: 0 instead of format: "table") were causing validation errors
and being skipped during ingestion.

Co-authored-by: ulixius9 <39544459+ulixius9@users.noreply.github.com>

* fix: GrafanaTarget model format type from str to Any

---------

Co-authored-by: copilot-swe-agent[bot] <198982749+Copilot@users.noreply.github.com>
Co-authored-by: ulixius9 <39544459+ulixius9@users.noreply.github.com>
Co-authored-by: Sriharsha Chintalapani <harshach@users.noreply.github.com>
Co-authored-by: Keshav Mohta <keshavmohta09@gmail.com>
2025-10-12 23:14:16 +05:30
harshsoni2024
c32a9b957f
Add AWS kinesis firehose connector [OSS] (#23807)
* AWS Firehose

* Add AWS Firehose

* add kinesis fireshose support

* remove unnecessary doc

* Update generated TypeScript types

* add connection doc, optional msg service name

* Update generated TypeScript types

---------

Co-authored-by: Sriharsha Chintalapani <harsha@getcollate.io>
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Ayush Shah <ayush@getcollate.io>
2025-10-12 08:27:13 -07:00
Ayush Shah
d71a47db1d
fix(kafkaconnect): update table search method to use search_in_any_service (#23852) 2025-10-12 20:02:12 +05:30
Bhanu Agrawal
3801525263
Introduce unified ES/OS client API + separate index management (#23425)
* Setup new client for ES/OS

* Migrated createIndex and addIndexAlias methods

* Migrated createAliases method to new ES/OS client

* Migrated updateIndex and deleteIndex methods

* Updated indexExists methods

* refactor: extract index management operations into dedicated manager classes

* Add tests for ElasticSearch and OpenSearch index managers

* chore: fix code style issues"

* Added integeration tests for ES/OS index manager

* Fix log level

* Fixed priority key mapping for test_case_result_index

* fix test to use field name in the query as domains.id not domain.id

* Fixed failing tests

* Set headers so 8.x client can work with 7.17x or higher server for ES

* Added OpenSearch compatible stemmer configuration

* Fix java code style

* Fixed java checkstyle issue

* Added support for 7.17.x backward compatibility

* Fixed failing tests

* Updated client availability checks in both index manager classes to use the consistent !isClientAvailable pattern

* Removed comment

* chore: Fix line formatting in Playwright test files

- Adjusted line length in Domains.spec.ts for better readability
- Fixed indentation and formatting in Lineage.spec.ts
- Added missing newline at end of files

* Added new line

* Migrated other index related methods and add tests
2025-10-12 02:35:56 +05:30
Sriharsha Chintalapani
ce3a9bd654
Kafka connect improvements (#23845)
* Kafka Connect Lineage Improvements

* Remove specific Kafka topic example from docstring

Removed example from the documentation regarding the earnin.bank.dev topic.

* fix: update comment to reflect accurate example for database server name handling

* fix: improve expected FQN display in warning messages for missing Kafka topics

* fix: update table entity retrieval method in KafkaconnectSource

* fix: enhance lineage information checks and improve logging for missing configurations in KafkaconnectSource

* Kafka Connect Lineage Improvements

* address comments; work without the table.include.list

---------

Co-authored-by: Ayush Shah <ayush@getcollate.io>
2025-10-11 22:26:14 +02:00
Sriharsha Chintalapani
5c638f5c8e
Databricks DLT pipelines parsing (#23848) 2025-10-11 22:25:43 +02:00
Ayush Shah
a90cacc93b
MINOR: fix Kafka connect CDC lineage (#23836) 2025-10-11 15:40:03 +05:30
Harsh Vador
d4a9381473
fix(users): resolve search input losing characters during typing (#23832)
* fix(users): resolve search input losing characters during typing

* add test

* remove unwanted props & optimize code

* fix code smell
2025-10-11 10:55:40 +05:30
Ashish Gupta
6ce7623ca7
modify some data contract rule and supported playwright (#23766)
* supported contract owner rule additional playwright

* added all operator test for owners

* supported addition test for description operator

* change the description value from empty quotes to undefined to get that removed from data asset and the validation should work correctly on this

* Adding actualCase keyword to team and user index mappings

* change the query to displayName search from the fqn and name for better validation

* change the owner rule to name and added domain playwright test

* Conditional Sensitive Case Normalising in Search Aggregation

* Remove to lower case introduced by accident

* push the actual case field setting

* added is condition with teams for owners

* Reverted the displayName.actualCase changes

* reverted the owner back to fqn and supported fqn value and displayOption

* set the default operator for description

* changes made as per comments

---------

Co-authored-by: Ram Narayan Balaji <ramnarayanb3005@gmail.com>
2025-10-10 22:53:36 +05:30
Teddy
1f8cf64dd4
chore: added python 3.12 to CI (#23835)
* chore: added python 3.12 to CI

* chore: changed py-test-skip to 3.12
2025-10-10 17:26:45 +02:00
Teddy
93e5ee8cb1
fix: url encode fqn when retrieving test case results in python sdk (#23834) 2025-10-10 17:25:33 +02:00
Copilot
7b1d687f2d
Move logs summary from side panel to header for full-width logs display (#22307)
* Initial plan

* Move logs summary from side panel to header for full-width logs

Co-authored-by: harshach <38649+harshach@users.noreply.github.com>

* fix(test): update test description to reflect header layout instead of right panel

Co-authored-by: karanh37 <33024356+karanh37@users.noreply.github.com>

* fix failing unit test

* Update the UI for LogsViewerPage

* Fix sonarcloud issues

---------

Co-authored-by: copilot-swe-agent[bot] <198982749+Copilot@users.noreply.github.com>
Co-authored-by: harshach <38649+harshach@users.noreply.github.com>
Co-authored-by: Aniket Katkar <aniketkatkar97@gmail.com>
Co-authored-by: karanh37 <33024356+karanh37@users.noreply.github.com>
Co-authored-by: shrushti2000 <shrushtipolekar@gmail.com>
2025-10-10 20:14:09 +05:30
Ashish Gupta
9286933d5c
chore(ui): refactor data contract spec test (#23741)
* chore(ui): fix data contract flaky test around contract tab not found

* modify the test to have their own table to run to avoid flakiness

* fix contract failing

* revert unwanted commit

* change the contract test admin page way

* fix the blank page issue after redirect
2025-10-10 18:57:04 +05:30
Ashish Gupta
8ccd879655
PLAYWRIGHT: fix activity feed mention flaky test (#23823) 2025-10-10 18:55:24 +05:30
Ajith Prasad
9d0a739c69
LDAP login issues fixed, added retry mechanism (#23690)
* LDAP login issues fixed, added retry mechanism

* Remove unwanted comments

* Addressed copilot comments

* Added integration TCs for ldap
2025-10-10 18:46:26 +05:30
Rohit Jain
e23638da60
Fix: Updated the Metrics page subtitle text (#23805)
* Fix: Updated the Metrics page subtitle

* Playwright: Fixed the metric e2e test
2025-10-10 18:37:46 +05:30
Rohit Jain
f97ed64316
Fixes 22418: Fixed the teams page breadcrumb url issue (#23824)
* Fix: Fixed the teams page breadcrum url issue

* Playwright: Added test for verifing breadcrumb navigation for teams which contains dot in their name
2025-10-10 18:36:58 +05:30
Rohit Jain
598de16eea
Fix: Added docs url for Metrics page (#23803)
* Fix: Added docs url for Metrics page

* Playwright: Fixed the searchSetting e2e test

* Test: Added unit test for doc link in metric page
2025-10-10 18:32:05 +05:30
Adrià Manero
0b107569d7
NotificationTemplate Schema and Repository Improvements (#23769)
* NotificationTemplate Schema and Repository Improvements

* Update generated TypeScript types

---------

Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Aniket Katkar <aniketkatkar97@gmail.com>
2025-10-10 14:49:33 +02:00
Aniket Katkar
13ab5af508
Safeguard the plugins use to avoid the flatMap error occurred during hot reloading (#23831) 2025-10-10 18:14:00 +05:30
Shailesh Parmar
1fa5641590
playwright: fix waitForAllLoadersToDisappear fn was not working as expected (#23822)
* playwright: fix waitForAllLoadersToDisappear fn was not working as expected

* revert playwright.config.ts changes
2025-10-10 17:59:14 +05:30
Teddy
b253105875
fix: missing numeric data support (#23826) 2025-10-10 11:21:34 +00:00
Teddy
6777ef6805
ISSUE #2034: BigQuery exporter (#23526)
* feat: bigquery exporter

* Update generated TypeScript types

* Update generated TypeScript types

---------

Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Teddy Crepineau <teddycrepineau@Teddys-MacBook-Work.local>
2025-10-10 12:20:23 +02:00
sonika-shah
0ec0a4dec5
Revert "add missing owners field in entity index mapping" (#23833)
This reverts commit cf75d76bc8d1ab5e7bf766f22c352c42c9992807.
2025-10-10 15:32:28 +05:30
Ushran Gouhar
dfda6323c5
fix(ui): codeql-1693 Incomplete multi-character sanitization fix (#23738) 2025-10-10 10:01:11 +00:00
sonikashah
cf75d76bc8 add missing owners field in entity index mapping 2025-10-10 15:25:23 +05:30
Rohit Jain
d6b4982628
Fix: Update boolean field layout to show switch before label (#23812) 2025-10-10 14:48:36 +05:30
Ushran Gouhar
c66b02d646
Add Button component (#23811)
* Add button component and stories

* Use Button from component library

* Using MuiButton only
2025-10-10 14:40:46 +05:30
Sriharsha Chintalapani
76020bd0e7
Fix Kafka Connect for lineage parsing (#23819)
* Fix Kafka Connect for lineage parsing

* Fix Kafka Connect for lineage parsing
2025-10-09 14:01:36 -07:00
Mayur Singal
88115e1218
MINOR: Fix training / issue in UC S3 lineage (#23816) 2025-10-09 18:44:07 +02:00
Antoine Balliet
be3a91f7df
fix: logger level should work for deprecation warnings (#23784)
* chore: implement logger levels tests for depreciation

* fix: use METADATA_LOGGER instead of warnings

* use unit test syntax

* isort

* black

* fix test

---------

Co-authored-by: Sriharsha Chintalapani <harshach@users.noreply.github.com>
2025-10-09 18:21:28 +02:00