13272 Commits

Author SHA1 Message Date
satish
789e491528
Switch to react-data-grid for Grid Component (#22279)
* Switch to react-data-grid for Grid Component

* Rdg styling and tests update

* Replace grid in EditTableTypeProperty and other fixes

* Update focus trap

* Fix data grid rerendering on user search issue

* Fix sonarqube issues and a playwright issue

* Fix glossary status column filter issue

* Address review comments

* Certificatation overlay class update

* Max width to certification popover

---------

Co-authored-by: Satish <satish@Satishs-MacBook-Pro.local>
2025-07-16 18:16:57 +05:30
Rounak Dhillon
8c20723f77
Docs: Quick Start Fix (#22394)
Co-authored-by: “Rounak <“rounakpreet.d@deuexsolutions.com”>
2025-07-16 12:02:32 +00:00
Rounak Dhillon
c814b18ead
Docs: Meta Description Updation (#22386)
Co-authored-by: “Rounak <“rounakpreet.d@deuexsolutions.com”>
2025-07-16 14:55:13 +05:30
Rounak Dhillon
a234298347
Docs: Team Note Addition in Team Structure (#22384)
* Docs: Team Note Addition in Team Structure

* Docs: Team Note Addition in Team Structure

---------

Co-authored-by: “Rounak <“rounakpreet.d@deuexsolutions.com”>
2025-07-16 05:33:15 +00:00
Shailesh Parmar
b762a0d7eb
Revert "supported playwright test for nested columns suggestions (#22361)" (#22374)
This reverts commit 2c97b7ae2ff377b97b7fe1d868d2c4acc41fb2b3.
2025-07-15 21:09:50 +05:30
Ajith Prasad
7e8c11953e
Username extraction from jwtprincipalclaimsmapping, if email format (#22350)
* Username extraction from jwtprincipalclaimsmapping, when email format given

* Removed reduntant method
2025-07-15 20:23:53 +05:30
Suman Maharana
9838278ac4
Add: Schema and Database Mark Deletion (#22088)
* Added Schema and Database Mark Deletion

* removed unnecessary changes

* fixed marked deleted databases

* Added to all db connectors

* Added generated types

* Added tests
2025-07-15 16:26:46 +02:00
Rounak Dhillon
174e6ed980
Docs: Meta Description Updation (#22376)
Co-authored-by: “Rounak <“rounakpreet.d@deuexsolutions.com”>
2025-07-15 14:16:59 +00:00
Shailesh Parmar
71ad8766d9
Refactor: Update DataQualityAndProfiler tests and ColumnProfileTable logic (#22364)
* Refactor: Update DataQualityAndProfiler tests and ColumnProfileTable logic

- Replaced `createNewPage` with `performAdminLogin` for improved login handling in DataQualityAndProfiler tests.
- Enhanced test case for profiler matrix visibility to include checks for admin, data consumer, and data steward roles.
- Updated ColumnProfileTable to use `fqn` consistently instead of `tableProfiler?.fullyQualifiedName` for fetching table columns.

This refactor aims to streamline the test setup and improve code clarity.

* Enhance ColumnProfileTable to utilize getTableFQNFromColumnFQN for improved FQN handling

- Updated ColumnProfileTable to derive table FQN from column FQN using the new utility function.
- Refactored related logic to ensure consistent usage of table FQN across navigation and data fetching.
- Added unit tests for getTableFQNFromColumnFQN to validate its functionality.

This change aims to streamline the handling of fully qualified names in the profiler component.
2025-07-15 19:32:28 +05:30
Ram Narayan Balaji
05fa0b3185
Minor Fix: Add upstreamLineage in Directory, Worksheet, File, Spreadsheet DriveService Search Indexers (#22346)
* Fix: Add upstreamLineage in DriveService ES DOC

* fix: add upstreamLineage to all drive-related ES indexers
2025-07-15 19:28:40 +05:30
Mohit Yadav
860694e0af
Fix Null Columns (#22365) 2025-07-15 06:10:45 -07:00
Suman Maharana
5b3bb637fb
Fix: Postgres query column name for exec time (#22366) 2025-07-15 12:58:53 +00:00
Dhruv Parmar
16d83c8ba0
fix(ui): Handle text overflow in CommonEntitySummaryInfo and fix loader in search bar (#22330)
* fixed overflow & search issue

* fixed popover content

* removed unncessary code
2025-07-15 18:21:39 +05:30
Dhruv Parmar
c3cf12f444
Minor(ui): Fixed Pagination alignment (#22333)
* fixed pagination disalignment

* fixed pagination disalignment
2025-07-15 18:18:13 +05:30
Rounak Dhillon
7f4eb3a14f
Docs: Meta Description Updation (#22368)
* Docs: Meta Description Updation

* Docs: Meta Description Updation

---------

Co-authored-by: “Rounak <“rounakpreet.d@deuexsolutions.com”>
2025-07-15 12:19:33 +00:00
Mohit Yadav
d6814614cf
Policy Improvements (#22273)
* - Removed Trimmed Permissions
- Fix Sample Data

* Add View Permissions Per Entity Api

* Remove Permission Trim for all calls

* Added generic function to prioritize field-level permissions over view all

* refactor: create separate edit and view permission functions

* add granular view and edit permission validation for entity pages

* update DataQuality components with granular permission checks

* update Domain related components with granular permission checks

* fix sonar cloud failure and address pr comment

* update Metric

* added playwright test for entities and fix failing unit test

* fix table profiler

* fix test and minor fix

* fix sonar cloud issues

* minor fix

* address pr comments and fix failing tests

* fix test

* fix test

---------

Co-authored-by: shrushti2000 <shrushtipolekar@gmail.com>
2025-07-15 17:47:17 +05:30
sonika-shah
0cab4d1cbf
Fix soft-delete and restore handling for charts linked to dashboards during dashboard delete/restore operations (#22168)
* Fix soft-delete and restore handling for charts linked to dashboards during dashboard delete/restore operations

* remove the search script no longer required

* resolve conflict
2025-07-15 17:24:33 +05:30
Ashish Gupta
f93e6758a6
FIX: the race condition in bulk import around websocket and restAPI (#22277)
* fix the race condition in bulk import around websocket and restAPI

* Fix for Race condition

* remove the ui race condition fix

* re-switch the function to old place to avoid unwanted file change

* added ui support to tackle race condition as per backend changes

* fix the localization keys and unsave the data after restAPI call, since we are getting it from websocket started response

* fix bulk edit table flakyness

* minor code fixes

* fix the bulk action being affected if multiple tab open for same page and increase the database test time to avoid flakyness

* Fix Failing Test

---------

Co-authored-by: mohitdeuex <mohit.y@deuexsolutions.com>
Co-authored-by: Sriharsha Chintalapani <harshach@users.noreply.github.com>
2025-07-15 17:10:58 +05:30
Suman Maharana
ea63d7e184
remove dbx debug tests (#22264) 2025-07-15 12:56:10 +02:00
Sriharsha Chintalapani
e9b91bb5d4
User Activity Metrics (#22354)
* User Activity Metrics

* Fix tests
2025-07-15 11:35:20 +02:00
Pere Miquel Brull
513350e623
MINOR - Update JVM params (#22334)
* MINOR - Update JVM params

* Update openmetadata-server-start.sh

---------

Co-authored-by: Sriharsha Chintalapani <harshach@users.noreply.github.com>
2025-07-15 11:34:40 +02:00
Ashish Gupta
2c97b7ae2f
supported playwright test for nested columns suggestions (#22361) 2025-07-15 14:59:43 +05:30
Rounak Dhillon
909d57b502
Docs: SMTP Note Addition (#22360)
Co-authored-by: “Rounak <“rounakpreet.d@deuexsolutions.com”>
2025-07-15 08:28:28 +00:00
Rounak Dhillon
1498bf68a0
Docs: ThoughtSpot Connector Addition (#22358)
* Docs: ThoughtSpot Connector Addition

* Docs: ThoughtSpot Connector Addition

---------

Co-authored-by: “Rounak <“rounakpreet.d@deuexsolutions.com”>
Co-authored-by: Prajwal214 <167504578+Prajwal214@users.noreply.github.com>
2025-07-15 07:51:10 +00:00
Pere Miquel Brull
397c41457c
MINOR - Add columns.description in search settings (#22299)
* MINOR - Add columns.description in search settings

* remove from defaults
2025-07-15 09:21:57 +02:00
Suman Maharana
f73b3bc643
Add: missing supportsMetadataExtraction flag in connectors (#22296)
* Add: missing supportsMetadataExtraction flag in connectors

* addressed comments

* generate types
2025-07-15 08:34:56 +02:00
Akash Verma
6f42921c88
feature: thoughtspot connector (#22266)
* feature: thoughtspot connector

* java and ts files

* java checkstyle

* rm java files

* ui changes

* java files

* minor changes

---------

Co-authored-by: Akash Verma <akashverma@Akashs-MacBook-Pro-2.local>
Co-authored-by: Aniket Katkar <aniketkatkar97@gmail.com>
Co-authored-by: Keshav Mohta <68001229+keshavmohta09@users.noreply.github.com>
2025-07-15 07:59:10 +02:00
Pere Miquel Brull
3960878de4
FIX #22216 - Recursive suggestion application for deeply nested columns (#22348) 2025-07-15 06:51:46 +02:00
Aniket Katkar
d499a8821e
I worked on fixing the flakiness in ObservabilityAlerts.spec.ts (#22336) 2025-07-15 10:12:59 +05:30
Aniket Katkar
08f3873475
Fix#21401: Auto pilot trigger button enable and improve test coverage (#22329)
* Modify the condition to only disable the Run Agents button when AutoPilot is in RUNNING state.

* Add playwright coverage for agents deletion confirmation after service is deleted
2025-07-15 09:56:57 +05:30
Ajith Prasad
73276fe49a
Handling NPE reading appPrivateConfig with empty parameters (#22292)
Co-authored-by: Mohit Yadav <105265192+mohityadav766@users.noreply.github.com>
2025-07-15 09:37:43 +05:30
zuohuan
acb7e4dcef
Fix #22244 - Fix issues in zh language search index mapping (#22295)
Co-authored-by: zuohuan <zuohua12@163.com>
2025-07-15 09:31:12 +05:30
Sriharsha Chintalapani
46a35d075c
Fix multiple relation batch update (#22352)
* Fix multiple relationship bulk add

* Remove unused code
2025-07-14 15:01:49 -07:00
Mohit Yadav
b48a02d94e
Fix Column Lineage Validation issue (#22308)
* Fix Column Lineage Validation issue

* Add test for validations

---------

Co-authored-by: Sriharsha Chintalapani <harshach@users.noreply.github.com>
2025-07-14 19:25:49 +05:30
mohitdeuex
5e7fb80d05 Fix App Uninstall Flow 2025-07-14 18:26:45 +05:30
Rounak Dhillon
8b1bd242d7
Docs: Meta Updation (#22332)
Co-authored-by: “Rounak <“rounakpreet.d@deuexsolutions.com”>
2025-07-14 12:44:31 +00:00
Ram Narayan Balaji
4af8ac065d
Fix: Extract Proper Parent FQN for column fqn (#22300)
* Fix: Extract Proper Parent FQN for column fqn

* Fix tests
2025-07-14 17:22:58 +05:30
Ashish Gupta
f581ebbbe4
#19932: supported global pageSize change for pagination (#22251)
* supported global pageSize change for pagination

* fix the explore page size issue

* change default page size from 50 to 15

* fix unit and added playwright test for it

* modify playwright file page to work independently so won't affect globally

* made the changes as per comments
2025-07-14 17:12:26 +05:30
Pere Miquel Brull
a86c51e82d
MINOR - Keep presidio logger at ERROR (#22124)
* MINOR - Keep presidio debug at ERROR

* test

---------

Co-authored-by: Keshav Mohta <68001229+keshavmohta09@users.noreply.github.com>
Co-authored-by: Sriharsha Chintalapani <harshach@users.noreply.github.com>
2025-07-14 11:55:02 +02:00
Chirag Madlani
707a3b5d2d
Feat whats new redesign (#22107)
* feat(ui): redesign what's new alert

* update local

* update

* update

* support links

* fix navbar crash (#22212)

* MINOR: Fix pytest 3.10 running too long (#22211)

* [FIX] 21910: Update amundsen ingest (#22201)

Addresses: #21910

Removed 'Either' that currently wraps the generators being yieded from
in the amundsen `metadata.py` from the `AmundsenSource` class. I think
these are not necessary and causing the issue since the objects being
yielded inside those methods (`self.create_table_entity`, etc) are all
yielding `Either` objects.

Tested on my local instance and this resolved the issue with the service
not being able to ingest.

Co-authored-by: Mayur Singal <39544459+ulixius9@users.noreply.github.com>

* MINOR: Improve Array Sampler for UC & DBX (#22155)

* MINOR: Improve Array Sampler for UC & DBX

* make log debug

* address comments

* Fix the deleted assets showing even when deleted switch is not checked (#22217)

* Fix the failing playwright for service ingestion (#22218)

* parametrize get private key for snowflake (#22214)

* Schema Change Alert Not Triggering for Team Owner with Slack Destination (#22215)

* [Snyk] Security upgrade react-i18next from 11.18.6 to 15.5.3 (#21785)

* fix: openmetadata-ui/src/main/resources/ui/package.json & openmetadata-ui/src/main/resources/ui/yarn.lock to reduce vulnerabilities

The following vulnerabilities are fixed with an upgrade:
- https://snyk.io/vuln/SNYK-JS-BABELRUNTIME-10044504

* Empty commit

* Fix type errors

---------

Co-authored-by: snyk-bot <snyk-bot@snyk.io>
Co-authored-by: Aniket Katkar <aniketkatkar97@gmail.com>

* Fixes #18151 : change replaced copy by model_copy (#18153)

* feat: replace copy

* fix native python copy

---------

Co-authored-by: IceS2 <pjt1991@gmail.com>

* Fix #20145: Implemented Prefix For Dashboard Service (#21585)

* feat: implemented microstrategy lineage & dbServicePrefix

* feat: added dbServicePrefixes support in other dashboards

* fix: test_metabase and powerbi extra code remove

* fix: python checkstyle

* refactor: added prefix support for other connectors - superset, tableau, etc

* refactor: added migration for prefix change and fix dbServicePrefixes field description

* refactor: added prefix changes in superset db source

* doc: add prefix in tableau doc

* fix: typescript files and postgres migration for prefix

* fix: moved migration in 1.8.2

---------

Co-authored-by: Pere Miquel Brull <peremiquelbrull@gmail.com>

* fix test (#22226)

* fix test (#22220)

* fix table filter test (#22219)

Co-authored-by: Shailesh Parmar <shailesh.parmar.webdev@gmail.com>

* pass test case result ts as event time (#22190)

* Fix Patch Tool (#22222)

Co-authored-by: Sriharsha Chintalapani <harshach@users.noreply.github.com>

* added tests for current user store (#22221)

Co-authored-by: Sriharsha Chintalapani <harshach@users.noreply.github.com>

* Handle quoted entity names in masking queries (#22174)

Co-authored-by: Sriharsha Chintalapani <harshach@users.noreply.github.com>

* Fix #1751: Include Column Constraint in DI Charts (#22199)

Co-authored-by: Sriharsha Chintalapani <harshach@users.noreply.github.com>

* Update operations.yaml (#22231)

Fix email templates

* Add lineage stored procedure and view filter pattern support (#22223)

* Add lineage stored procedure and view filter pattern support

* Update generated TypeScript types

* Add tests for lineage filter pattern

---------

Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Sriharsha Chintalapani <harshach@users.noreply.github.com>

* Docs update (#22232)

* Docs: Fix links in secrets manager docs

* Docs: fix dbt Cloud typos in docs

---------

Co-authored-by: Nick Acosta <nick.acosta@getcollate.io>

* Slack Application Document Addition in Collate (#22213)

Co-authored-by: “Rounak <“rounakpreet.d@deuexsolutions.com”>
Co-authored-by: Prajwal214 <167504578+Prajwal214@users.noreply.github.com>

* Add Permission Debugger to understand roles & permissions for a user (#22207)

* Add debug api endpoints for roles & policies

* Add Roles & Policy Debugger

* fix errors

* Address comments

* Address comments

---------

Co-authored-by: Chirag Madlani <12962843+chirag-madlani@users.noreply.github.com>

* fix: cross-platform path resolution for dbt ingestion (on Windows) (#22230)

* fix: windows os dbt ingestion fix

* py formatting

---------

Co-authored-by: --global <--global>

* fix tests

* fix tests

* fix issue with cookie version

* fix tests

* fix tour spec

* address comments

---------

Co-authored-by: Dhruv Parmar <83108871+dhruvjsx@users.noreply.github.com>
Co-authored-by: Mayur Singal <39544459+ulixius9@users.noreply.github.com>
Co-authored-by: Mike Kutzma <michaelkutzma@gmail.com>
Co-authored-by: Aniket Katkar <aniketkatkar97@gmail.com>
Co-authored-by: IceS2 <pjt1991@gmail.com>
Co-authored-by: Ajith Prasad <37380177+aji-aju@users.noreply.github.com>
Co-authored-by: Akash Jain <15995028+akash-jain-10@users.noreply.github.com>
Co-authored-by: snyk-bot <snyk-bot@snyk.io>
Co-authored-by: Ethan <63649819+kuma0128@users.noreply.github.com>
Co-authored-by: Keshav Mohta <68001229+keshavmohta09@users.noreply.github.com>
Co-authored-by: Pere Miquel Brull <peremiquelbrull@gmail.com>
Co-authored-by: Shrushti Polekar <shrushtipolekar@gmail.com>
Co-authored-by: Shailesh Parmar <shailesh.parmar.webdev@gmail.com>
Co-authored-by: Teddy <teddy.crepineau@gmail.com>
Co-authored-by: Mohit Yadav <105265192+mohityadav766@users.noreply.github.com>
Co-authored-by: Sriharsha Chintalapani <harshach@users.noreply.github.com>
Co-authored-by: Mohit Tilala <63147650+mohittilala@users.noreply.github.com>
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Nick Acosta <30478672+PubChimps@users.noreply.github.com>
Co-authored-by: Nick Acosta <nick.acosta@getcollate.io>
Co-authored-by: Rounak Dhillon <162090200+RounakDhillon@users.noreply.github.com>
Co-authored-by: “Rounak <“rounakpreet.d@deuexsolutions.com”>
Co-authored-by: Prajwal214 <167504578+Prajwal214@users.noreply.github.com>
Co-authored-by: Himanshu Khairajani <46777429+Khairajani@users.noreply.github.com>
2025-07-14 13:16:18 +05:30
Ayush Shah
fe2caf7a5d
MINOR: Enhance patch request handling by adding 'skip_on_failure' parameter (#22142)
* Enhance patch request handling by adding 'skip_on_failure' parameter

* Introduced 'skip_on_failure' option in build_patch and OMetaPatchMixin methods to control behavior on patch operation failures.
* Updated documentation to reflect the new parameter and its default value.
* Improved error handling to log warnings instead of raising exceptions when 'skip_on_failure' is set to True.

* fix: add tests for patch request with skip on failure

* refactor: streamline mock patching and improve test readability in patch request tests

* Consolidated import statements for unittest mock.
* Enhanced readability by reducing line breaks and simplifying mock patching syntax.
* Ensured consistent use of commas in function calls for clarity.
* Updated tests to maintain functionality while improving code style.

* fix: improve error handling in patch operations

* Enhanced logging for patch operation failures in both build_patch and OMetaPatchMixin methods.
* Added detailed entity information in warning and error messages to aid in debugging.
* Ensured consistent behavior when 'skip_on_failure' is set, providing clearer feedback on operation outcomes.

* fix: clean up whitespace in patch request error handling

* Removed unnecessary whitespace in the build_patch function to improve code readability.
* Ensured consistent formatting in warning and error messages for better clarity during logging.

* fix: enhance error handling and improve test assertions in patch request

* Updated the condition for checking 'changeDescription' in the _remove_change_description function for better clarity.
* Modified exception handling in tests to raise RuntimeError instead of a generic Exception, providing more specific error feedback.
* Improved assertions in tests to check for the presence of error messages, enhancing the robustness of error handling verification.
* Adjusted test cases to reflect changes in expected patch operation counts and ensure accurate validation of patch operations.

* fix: enhance patch operation with skip_on_failure handling

* Added 'skip_on_failure' parameter to OMetaPatchMixin methods to control behavior on patch failures.
* Improved error handling to log warnings and provide detailed feedback when patch operations are skipped.
* Updated tests to verify the new behavior of skipping failures and improved assertions for clarity.
2025-07-14 12:33:17 +05:30
Sriharsha Chintalapani
0b82e2e2a2
Fix EntityRelationshipCleanupTest, failing intermittently (#22322) 2025-07-13 15:00:13 -07:00
Sriharsha Chintalapani
d1c92fbe05
Fix #22990: Add ETag Support for Optimistic Concurrency Control in PATCH Operations (#22291)
* Fix #22990: Add ETag Support for Optimistic Concurrency Control in PATCH Operations

* Fix tests

* Add package.json back
2025-07-13 14:59:49 -07:00
Sriharsha Chintalapani
2c43cfe854
Add improvements to storing tags in PATCH or PUT (#22297)
* Add improvements to storing tags in PATCH or PUT

* Add bulk updates to owners, domains etc..

* Fix styling

* Optimize tag comparison performance from O(n²) to O(n)

Replace nested stream().anyMatch() operations with Set-based lookups in
updateTags() method. This reduces time complexity for tag operations from
O(n²) to O(n) by using createTagKey() and createTagKeySet() helper methods.

Performance impact: For 1000 tags, reduces operations from ~1M to ~1K.

Co-authored-by: Sriharsha Chintalapani <harshach@users.noreply.github.com>

* Fix stylecheck

---------

Co-authored-by: claude[bot] <209825114+claude[bot]@users.noreply.github.com>
2025-07-13 07:57:56 -07:00
Suresh Srinivas
2c1ccca730
Remove unnecessary exception throws, Redundant lambda code and javadoc (#22321)
* Remove unnecessary exception throws, Rredundant labmda code and javadoc

* Fix java checkstyle issues
2025-07-12 17:26:00 -07:00
Pere Miquel Brull
7561289208
Update claude-code-review.yml (#22320) 2025-07-12 19:40:24 +02:00
Teddy
cc80bd6f3c
Add Claude Code GitHub Workflow (#22315)
* Update Claude PR Assistant workflow

* Claude Code Review workflow
2025-07-11 11:43:11 -07:00
Teddy
9b07fc0805
fix: claude workflow token (#22314) 2025-07-11 10:54:49 -07:00
Teddy
1cfa4d5f0f
feat: add claude assistant (#22313) 2025-07-11 10:25:32 -07:00
Sriharsha Chintalapani
58cd7daf7e
Add drive as service (#22159)
* Fix #22157: Add Drive Service Support to OpenMetadata

* Fix #22157: Add Drive Service Support to OpenMetadata

* Update generated TypeScript types

* Fix tests

* Update generated TypeScript types

* Fix tests

* Tests are passing

* Tests are passing

* Update generated TypeScript types

* Address comments

* Update generated TypeScript types

* Add sample data and ingestion for drives, directories, spreadsheets, worksheets, files

* Fix postgres migrations

* Fix postgres tests, optimize queries

---------

Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Pere Miquel Brull <peremiquelbrull@gmail.com>
2025-07-11 10:00:54 -07:00