13299 Commits

Author SHA1 Message Date
Shailesh Parmar
2d0970a657 Merge remote-tracking branch 'origin/main' into revamp-data-quality-ui 2025-07-14 16:45:56 +05:30
Shailesh Parmar
3749982839 Refactor Data Quality Test Cases and Improve UI Interactions
- Updated test case creation and editing flows in various spec files to enhance user experience and reliability.
- Replaced deprecated selectors and improved response handling for API calls.
- Streamlined pagination functionality in test cases list to ensure proper visibility and interaction.
- Enhanced permission checks in DataQualityPage and TestCaseFormV1 to ensure proper access control.
- Improved loading states and notifications for better user feedback during test case operations.
2025-07-14 16:39:40 +05:30
Pere Miquel Brull
a86c51e82d
MINOR - Keep presidio logger at ERROR (#22124)
* MINOR - Keep presidio debug at ERROR

* test

---------

Co-authored-by: Keshav Mohta <68001229+keshavmohta09@users.noreply.github.com>
Co-authored-by: Sriharsha Chintalapani <harshach@users.noreply.github.com>
2025-07-14 11:55:02 +02:00
Chirag Madlani
707a3b5d2d
Feat whats new redesign (#22107)
* feat(ui): redesign what's new alert

* update local

* update

* update

* support links

* fix navbar crash (#22212)

* MINOR: Fix pytest 3.10 running too long (#22211)

* [FIX] 21910: Update amundsen ingest (#22201)

Addresses: #21910

Removed 'Either' that currently wraps the generators being yieded from
in the amundsen `metadata.py` from the `AmundsenSource` class. I think
these are not necessary and causing the issue since the objects being
yielded inside those methods (`self.create_table_entity`, etc) are all
yielding `Either` objects.

Tested on my local instance and this resolved the issue with the service
not being able to ingest.

Co-authored-by: Mayur Singal <39544459+ulixius9@users.noreply.github.com>

* MINOR: Improve Array Sampler for UC & DBX (#22155)

* MINOR: Improve Array Sampler for UC & DBX

* make log debug

* address comments

* Fix the deleted assets showing even when deleted switch is not checked (#22217)

* Fix the failing playwright for service ingestion (#22218)

* parametrize get private key for snowflake (#22214)

* Schema Change Alert Not Triggering for Team Owner with Slack Destination (#22215)

* [Snyk] Security upgrade react-i18next from 11.18.6 to 15.5.3 (#21785)

* fix: openmetadata-ui/src/main/resources/ui/package.json & openmetadata-ui/src/main/resources/ui/yarn.lock to reduce vulnerabilities

The following vulnerabilities are fixed with an upgrade:
- https://snyk.io/vuln/SNYK-JS-BABELRUNTIME-10044504

* Empty commit

* Fix type errors

---------

Co-authored-by: snyk-bot <snyk-bot@snyk.io>
Co-authored-by: Aniket Katkar <aniketkatkar97@gmail.com>

* Fixes #18151 : change replaced copy by model_copy (#18153)

* feat: replace copy

* fix native python copy

---------

Co-authored-by: IceS2 <pjt1991@gmail.com>

* Fix #20145: Implemented Prefix For Dashboard Service (#21585)

* feat: implemented microstrategy lineage & dbServicePrefix

* feat: added dbServicePrefixes support in other dashboards

* fix: test_metabase and powerbi extra code remove

* fix: python checkstyle

* refactor: added prefix support for other connectors - superset, tableau, etc

* refactor: added migration for prefix change and fix dbServicePrefixes field description

* refactor: added prefix changes in superset db source

* doc: add prefix in tableau doc

* fix: typescript files and postgres migration for prefix

* fix: moved migration in 1.8.2

---------

Co-authored-by: Pere Miquel Brull <peremiquelbrull@gmail.com>

* fix test (#22226)

* fix test (#22220)

* fix table filter test (#22219)

Co-authored-by: Shailesh Parmar <shailesh.parmar.webdev@gmail.com>

* pass test case result ts as event time (#22190)

* Fix Patch Tool (#22222)

Co-authored-by: Sriharsha Chintalapani <harshach@users.noreply.github.com>

* added tests for current user store (#22221)

Co-authored-by: Sriharsha Chintalapani <harshach@users.noreply.github.com>

* Handle quoted entity names in masking queries (#22174)

Co-authored-by: Sriharsha Chintalapani <harshach@users.noreply.github.com>

* Fix #1751: Include Column Constraint in DI Charts (#22199)

Co-authored-by: Sriharsha Chintalapani <harshach@users.noreply.github.com>

* Update operations.yaml (#22231)

Fix email templates

* Add lineage stored procedure and view filter pattern support (#22223)

* Add lineage stored procedure and view filter pattern support

* Update generated TypeScript types

* Add tests for lineage filter pattern

---------

Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Sriharsha Chintalapani <harshach@users.noreply.github.com>

* Docs update (#22232)

* Docs: Fix links in secrets manager docs

* Docs: fix dbt Cloud typos in docs

---------

Co-authored-by: Nick Acosta <nick.acosta@getcollate.io>

* Slack Application Document Addition in Collate (#22213)

Co-authored-by: “Rounak <“rounakpreet.d@deuexsolutions.com”>
Co-authored-by: Prajwal214 <167504578+Prajwal214@users.noreply.github.com>

* Add Permission Debugger to understand roles & permissions for a user (#22207)

* Add debug api endpoints for roles & policies

* Add Roles & Policy Debugger

* fix errors

* Address comments

* Address comments

---------

Co-authored-by: Chirag Madlani <12962843+chirag-madlani@users.noreply.github.com>

* fix: cross-platform path resolution for dbt ingestion (on Windows) (#22230)

* fix: windows os dbt ingestion fix

* py formatting

---------

Co-authored-by: --global <--global>

* fix tests

* fix tests

* fix issue with cookie version

* fix tests

* fix tour spec

* address comments

---------

Co-authored-by: Dhruv Parmar <83108871+dhruvjsx@users.noreply.github.com>
Co-authored-by: Mayur Singal <39544459+ulixius9@users.noreply.github.com>
Co-authored-by: Mike Kutzma <michaelkutzma@gmail.com>
Co-authored-by: Aniket Katkar <aniketkatkar97@gmail.com>
Co-authored-by: IceS2 <pjt1991@gmail.com>
Co-authored-by: Ajith Prasad <37380177+aji-aju@users.noreply.github.com>
Co-authored-by: Akash Jain <15995028+akash-jain-10@users.noreply.github.com>
Co-authored-by: snyk-bot <snyk-bot@snyk.io>
Co-authored-by: Ethan <63649819+kuma0128@users.noreply.github.com>
Co-authored-by: Keshav Mohta <68001229+keshavmohta09@users.noreply.github.com>
Co-authored-by: Pere Miquel Brull <peremiquelbrull@gmail.com>
Co-authored-by: Shrushti Polekar <shrushtipolekar@gmail.com>
Co-authored-by: Shailesh Parmar <shailesh.parmar.webdev@gmail.com>
Co-authored-by: Teddy <teddy.crepineau@gmail.com>
Co-authored-by: Mohit Yadav <105265192+mohityadav766@users.noreply.github.com>
Co-authored-by: Sriharsha Chintalapani <harshach@users.noreply.github.com>
Co-authored-by: Mohit Tilala <63147650+mohittilala@users.noreply.github.com>
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Nick Acosta <30478672+PubChimps@users.noreply.github.com>
Co-authored-by: Nick Acosta <nick.acosta@getcollate.io>
Co-authored-by: Rounak Dhillon <162090200+RounakDhillon@users.noreply.github.com>
Co-authored-by: “Rounak <“rounakpreet.d@deuexsolutions.com”>
Co-authored-by: Prajwal214 <167504578+Prajwal214@users.noreply.github.com>
Co-authored-by: Himanshu Khairajani <46777429+Khairajani@users.noreply.github.com>
2025-07-14 13:16:18 +05:30
Ayush Shah
fe2caf7a5d
MINOR: Enhance patch request handling by adding 'skip_on_failure' parameter (#22142)
* Enhance patch request handling by adding 'skip_on_failure' parameter

* Introduced 'skip_on_failure' option in build_patch and OMetaPatchMixin methods to control behavior on patch operation failures.
* Updated documentation to reflect the new parameter and its default value.
* Improved error handling to log warnings instead of raising exceptions when 'skip_on_failure' is set to True.

* fix: add tests for patch request with skip on failure

* refactor: streamline mock patching and improve test readability in patch request tests

* Consolidated import statements for unittest mock.
* Enhanced readability by reducing line breaks and simplifying mock patching syntax.
* Ensured consistent use of commas in function calls for clarity.
* Updated tests to maintain functionality while improving code style.

* fix: improve error handling in patch operations

* Enhanced logging for patch operation failures in both build_patch and OMetaPatchMixin methods.
* Added detailed entity information in warning and error messages to aid in debugging.
* Ensured consistent behavior when 'skip_on_failure' is set, providing clearer feedback on operation outcomes.

* fix: clean up whitespace in patch request error handling

* Removed unnecessary whitespace in the build_patch function to improve code readability.
* Ensured consistent formatting in warning and error messages for better clarity during logging.

* fix: enhance error handling and improve test assertions in patch request

* Updated the condition for checking 'changeDescription' in the _remove_change_description function for better clarity.
* Modified exception handling in tests to raise RuntimeError instead of a generic Exception, providing more specific error feedback.
* Improved assertions in tests to check for the presence of error messages, enhancing the robustness of error handling verification.
* Adjusted test cases to reflect changes in expected patch operation counts and ensure accurate validation of patch operations.

* fix: enhance patch operation with skip_on_failure handling

* Added 'skip_on_failure' parameter to OMetaPatchMixin methods to control behavior on patch failures.
* Improved error handling to log warnings and provide detailed feedback when patch operations are skipped.
* Updated tests to verify the new behavior of skipping failures and improved assertions for clarity.
2025-07-14 12:33:17 +05:30
Shailesh Parmar
470e46a6fc Merge remote-tracking branch 'origin/main' into revamp-data-quality-ui 2025-07-14 10:23:37 +05:30
Sriharsha Chintalapani
0b82e2e2a2
Fix EntityRelationshipCleanupTest, failing intermittently (#22322) 2025-07-13 15:00:13 -07:00
Sriharsha Chintalapani
d1c92fbe05
Fix #22990: Add ETag Support for Optimistic Concurrency Control in PATCH Operations (#22291)
* Fix #22990: Add ETag Support for Optimistic Concurrency Control in PATCH Operations

* Fix tests

* Add package.json back
2025-07-13 14:59:49 -07:00
Sriharsha Chintalapani
2c43cfe854
Add improvements to storing tags in PATCH or PUT (#22297)
* Add improvements to storing tags in PATCH or PUT

* Add bulk updates to owners, domains etc..

* Fix styling

* Optimize tag comparison performance from O(n²) to O(n)

Replace nested stream().anyMatch() operations with Set-based lookups in
updateTags() method. This reduces time complexity for tag operations from
O(n²) to O(n) by using createTagKey() and createTagKeySet() helper methods.

Performance impact: For 1000 tags, reduces operations from ~1M to ~1K.

Co-authored-by: Sriharsha Chintalapani <harshach@users.noreply.github.com>

* Fix stylecheck

---------

Co-authored-by: claude[bot] <209825114+claude[bot]@users.noreply.github.com>
2025-07-13 07:57:56 -07:00
Shailesh Parmar
569137c12a Merge remote-tracking branch 'origin/main' into revamp-data-quality-ui 2025-07-13 18:38:21 +05:30
Shailesh Parmar
1373b0456a Enhance Permission Handling in Data Quality Components
- Integrated permission checks for creating and editing test cases in TestCaseFormV1 and BundleSuiteForm.
- Updated state management to reflect permission-based conditions for enabling features like pipeline creation and scheduler options.
- Refactored related components to ensure proper dependency handling in hooks.
- Improved test coverage for permission-related functionalities across affected components.
2025-07-13 18:36:27 +05:30
Shailesh Parmar
af39ce3515 Enhance TestCaseFormV1 with Permission Checks and Cleanup
- Integrated permission checking for creating test cases based on table access.
- Added loading state for permission checks to improve user experience.
- Cleaned up unused state variables and effects in TestCaseFormV1.
- Updated AddTestCaseList component to include necessary dependencies in hooks.
- Added new localization string for permission error messages.
2025-07-13 17:09:10 +05:30
Shailesh Parmar
c296b943a4 Refactor Data Quality Test Components and Remove Unused Code
- Removed the AddDataQualityTestV1 component and its associated tests.
- Updated AuthenticatedAppRouter to eliminate references to removed components.
- Refactored TestCaseFormV1 and BundleSuiteForm to remove the isDrawer prop and adjust related tests.
- Enhanced the integration of TestCaseFormV1 within the TableProfiler context for better drawer management.
- Cleaned up unused routes and constants related to data quality tests.
- Updated styles and tests to reflect the changes in component structure and functionality.
2025-07-13 14:01:03 +05:30
Suresh Srinivas
2c1ccca730
Remove unnecessary exception throws, Redundant lambda code and javadoc (#22321)
* Remove unnecessary exception throws, Rredundant labmda code and javadoc

* Fix java checkstyle issues
2025-07-12 17:26:00 -07:00
Pere Miquel Brull
7561289208
Update claude-code-review.yml (#22320) 2025-07-12 19:40:24 +02:00
Shailesh Parmar
b43aabb233 Merge remote-tracking branch 'origin/main' into revamp-data-quality-ui 2025-07-12 18:44:15 +05:30
Teddy
cc80bd6f3c
Add Claude Code GitHub Workflow (#22315)
* Update Claude PR Assistant workflow

* Claude Code Review workflow
2025-07-11 11:43:11 -07:00
Teddy
9b07fc0805
fix: claude workflow token (#22314) 2025-07-11 10:54:49 -07:00
Teddy
1cfa4d5f0f
feat: add claude assistant (#22313) 2025-07-11 10:25:32 -07:00
Sriharsha Chintalapani
58cd7daf7e
Add drive as service (#22159)
* Fix #22157: Add Drive Service Support to OpenMetadata

* Fix #22157: Add Drive Service Support to OpenMetadata

* Update generated TypeScript types

* Fix tests

* Update generated TypeScript types

* Fix tests

* Tests are passing

* Tests are passing

* Update generated TypeScript types

* Address comments

* Update generated TypeScript types

* Add sample data and ingestion for drives, directories, spreadsheets, worksheets, files

* Fix postgres migrations

* Fix postgres tests, optimize queries

---------

Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Pere Miquel Brull <peremiquelbrull@gmail.com>
2025-07-11 10:00:54 -07:00
Shailesh Parmar
4144d20cf5 Enhance BundleSuiteForm with Scheduler Functionality
- Added 'enableScheduler' option to the BundleSuiteForm interface.
- Updated tests to verify rendering and functionality of scheduler fields based on the toggle state.
- Refactored form to conditionally display scheduler-related fields when the scheduler is enabled.
- Ensured proper handling of form submission based on the scheduler's state.
2025-07-11 21:31:24 +05:30
Shailesh Parmar
a36bab172c
Merge branch 'main' into revamp-data-quality-ui 2025-07-11 19:28:09 +05:30
Ashish Gupta
178ea84a9b
PLAYWRIGHT: supported test around lineage drawer (#22281)
* supported test around lineage drawer

* added dashboard data model as well in the list

* fix new node suggestion not coming on search, drawer close not clicking due to longer div width and fix the playwrigth test on it

* fix the drag icon size in lineage left sidebar

* fix the list not updating after search

* fix the new node selector being overflowing and icon not visible
2025-07-11 19:10:29 +05:30
Shailesh Parmar
77ff3caa5d Merge remote-tracking branch 'origin/main' into revamp-data-quality-ui 2025-07-11 19:09:20 +05:30
Shailesh Parmar
8a04e433d6 Refactor BundleSuiteForm tests to improve clarity and functionality
- Updated imports to include React for better compatibility.
- Enhanced mock implementations for translation and alert handling.
- Improved test assertions for rendering components in different modes.
- Clarified comments regarding API availability for form submission.
2025-07-11 18:47:41 +05:30
Dhruv Parmar
2262161096
fix(ui): Updated button names (#22250)
* updated button names

* fix jest test

* update button names

* consistent submit button text

* updated forgot password form

* fixed sonar and playwright

* fixed playwright

---------

Co-authored-by: Sweta Agarwalla <swetaagarwalla13@gmail.com>
2025-07-11 16:54:17 +05:30
Shailesh Parmar
797fd42ad0 Update translations for various languages to improve clarity and consistency in user interface terms related to bundle suites, column levels, and scheduling descriptions. This enhances the overall user experience across multiple languages. 2025-07-11 16:36:11 +05:30
Rounak Dhillon
9ad9c9e89e
Docs: Meta Updation (#22180)
* Doc: Meta updation

* Doc: Meta updation

* Docs: Meta Updation

* Docs: Meta Updation

* Update index.md

* Update index.md

* Update index.md

* Update index.md

* Update index.md

* Update index.md

* Docs: Meta Updation

---------

Co-authored-by: “Rounak <“rounakpreet.d@deuexsolutions.com”>
Co-authored-by: Prajwal214 <167504578+Prajwal214@users.noreply.github.com>
2025-07-11 10:00:12 +00:00
Shailesh Parmar
47beb37acd Update translations for various languages to include new terms related to column and table levels, test application, and selection prompts. This enhances the user interface by providing clearer context in multiple languages. 2025-07-11 15:14:24 +05:30
Shailesh Parmar
061ef51add Enhance Data Quality UI with new icons and layout improvements
- Added new SVG icons for data assets coverage and health check to improve visual representation in the UI.
- Updated the PieChartSummaryPanel to include icons for better context in summary cards.
- Refactored form components to improve layout consistency and user experience.
- Introduced a new constant for maximum name length to enforce validation across forms.
- Enhanced styling for form switch containers to improve visual clarity and usability.
2025-07-11 15:12:30 +05:30
Dhruv Parmar
b397e8861a
Feat(ui): Add "Metric" as an Option for Entity Reference Type Dropdown (#22272)
* added matric to entity reference

* updated tests
2025-07-11 12:47:30 +05:30
Rounak Dhillon
9a364a5a8c
Doc: Meta Description Updation (#22120)
* Doc: Meta Description Updation

* Meta description updation

---------

Co-authored-by: “Rounak <“rounakpreet.d@deuexsolutions.com”>
Co-authored-by: Ayush Shah <ayush@getcollate.io>
Co-authored-by: Prajwal214 <167504578+Prajwal214@users.noreply.github.com>
2025-07-11 10:44:34 +05:30
Rounak Dhillon
703abc52f4
Doc: Meta updation (#22153)
* Doc: Meta updation

* Doc: Meta updation

---------

Co-authored-by: “Rounak <“rounakpreet.d@deuexsolutions.com”>
Co-authored-by: Ayush Shah <ayush@getcollate.io>
Co-authored-by: Prajwal214 <167504578+Prajwal214@users.noreply.github.com>
2025-07-11 10:44:19 +05:30
Rounak Dhillon
a61679e82f
Updation of backup-restore-metadata.md (#22206)
Co-authored-by: “Rounak <“rounakpreet.d@deuexsolutions.com”>
2025-07-11 05:02:45 +00:00
Rounak Dhillon
f759e57d91
Doc: Tableau Note Addition (#21928)
* Doc: Tableau Note Addition

* Doc: Tableau Note Updation

---------

Co-authored-by: “Rounak <“rounakpreet.d@deuexsolutions.com”>
Co-authored-by: Ayush Shah <ayush@getcollate.io>
Co-authored-by: Prajwal214 <167504578+Prajwal214@users.noreply.github.com>
2025-07-11 04:59:59 +00:00
Rounak Dhillon
91408d4440
Docs: Auto Classification Feature Updation (#22237)
* Auto Classification Feature Updation

* Auto Classification Feature Updation

---------

Co-authored-by: “Rounak <“rounakpreet.d@deuexsolutions.com”>
2025-07-11 04:45:04 +00:00
Rounak Dhillon
a18aa9518c
Docs: Keycloak SSO Troubleshooting Updation (#22253)
Co-authored-by: “Rounak <“rounakpreet.d@deuexsolutions.com”>
2025-07-11 04:44:40 +00:00
Rounak Dhillon
102e07d766
Email Alerts Config Removal (#22225)
Co-authored-by: “Rounak <“rounakpreet.d@deuexsolutions.com”>
2025-07-11 04:43:45 +00:00
Rounak Dhillon
f7c1b909e8
Docs: 404 Error Fix (#22260)
Co-authored-by: “Rounak <“rounakpreet.d@deuexsolutions.com”>
2025-07-11 04:42:42 +00:00
Rounak Dhillon
7994ab80b3
RELEASE 1.8.3 Updation (#22282)
Co-authored-by: “Rounak <“rounakpreet.d@deuexsolutions.com”>
Co-authored-by: Prajwal214 <167504578+Prajwal214@users.noreply.github.com>
2025-07-11 09:51:07 +05:30
Sriharsha Chintalapani
e835c1074f
Revamp metrics, Add Request Latencies, breakdown database, search latencies (#22259)
* Add cleaner metrics

* Revamp Metrics; Add Request Latencies, breakdown database, search latencies

* Remove MicrometerBundleSingleton.java

* Fix tests
2025-07-10 11:34:30 -07:00
Shailesh Parmar
e2a08caaf7 Enhance Data Quality UI with error handling and styling improvements
- Added floating error alert functionality in EditTestCaseModalV1, TestCaseFormV1, and BundleSuiteForm for better user feedback.
- Introduced error message state management to display relevant error messages inline.
- Updated styles for floating error alerts to ensure visibility and consistency across components.
- Enhanced form submission error handling to provide clearer user guidance.
- Updated translations to include pipeline information for various languages.
2025-07-10 22:58:43 +05:30
Shailesh Parmar
70f3bea558 Add calendar SVG icon and refactor Data Quality UI components
- Introduced a new calendar SVG icon for enhanced visual representation.
- Refactored EditTestCaseModalV1 and TestCaseFormV1 components to improve layout and styling consistency.
- Updated form item classes and button types for better UX.
- Enhanced BundleSuiteForm with improved card sections and integrated AlertBar for contextual messaging.
- Removed unused BundleSuiteForm styles to streamline the codebase.
2025-07-10 20:40:57 +05:30
Rounak Dhillon
b8b0448147
Docs: OpenMetadata Changes in Collate (#22268)
* OpenMetadata Changes in Collate

* OpenMetadata Changes in Collate

---------

Co-authored-by: “Rounak <“rounakpreet.d@deuexsolutions.com”>
2025-07-10 08:06:34 -07:00
Rounak Dhillon
dfdc21086b
Docs: Configure Lineage Note Updation (#22284)
Co-authored-by: “Rounak <“rounakpreet.d@deuexsolutions.com”>
2025-07-10 13:12:44 +00:00
Prajwal214
d6a3a84eca
Revert #22175 (Update GitHub workflows to ignore changes in openmetadata-docs) (#22283)
Co-authored-by: Prajwal Pandit <prajwalpandit@MacBook-Pro.local>
2025-07-10 14:51:57 +02:00
Sweta Agarwalla
13a893059f
fix(test): AUT test failures (#22224)
* fix glossary version page playwright test

* fix lineage test
2025-07-10 15:00:54 +05:30
Rounak Dhillon
fd438345c7
Docs: 1.8.2 Release Update (#22263)
* Docs: 1.8.2 Release Update

* Docs: 1.8.2 Release Update

---------

Co-authored-by: “Rounak <“rounakpreet.d@deuexsolutions.com”>
2025-07-10 09:40:07 +02:00
Shrushti Polekar
8492e2909c
chore(ui): Update whats new for 1.8.3 (#22262)
* update whats new for 1.8.3

* minor update
2025-07-10 12:38:21 +05:30
Shailesh Parmar
84afdff5d0 Merge remote-tracking branch 'origin/main' into revamp-data-quality-ui 2025-07-10 12:19:59 +05:30