14126 Commits

Author SHA1 Message Date
Aniket Katkar
a27d36f41f
Fix the advanced search AUT failing due to page closed (#23904) 2025-10-16 10:13:55 +05:30
Rohit Jain
4942e2bdfb
Fixes 23104: Showing validation error if user enter duplicate service name (#23788)
* Fix: Showing validation error if user enter duplicate service name

* Fix: validate service name field on field change instead of form submit

* Playwright: Added e2e test for service name field validation errors

* Fix: fixed the services unit tests

* Fix: fixed the ConfigureService unit tests

* Fix: fixed code smells
2025-10-16 10:10:09 +05:30
Suman Maharana
63b663d884
Improve Tableau logging (#23892)
* Improve Tableau logging

* Addressed comments
2025-10-16 09:52:05 +05:30
sonika-shah
303ee47d6f
Add assets API and deprecate inline assets field for Domain and Dataproduct (#23856)
* Add assets API and deprecate inline assets field for Domain and Dataproduct

* fix mvn test

* fix py test and add new tests

* fix py test

* fix py test

* fix timeout for workflow test

* address pr feedback

* Update generated TypeScript types

* minor- remove unused function

---------

Co-authored-by: Bhanu Agrawal <bhanuagrawal2018@gmail.com>
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
2025-10-16 05:23:05 +05:30
Ashish Gupta
12da9f24eb
supported playwright for dataContract displayName (#23901) 2025-10-15 20:26:52 +05:30
Ushran Gouhar
ffe967ec6c
Ignore playwright tests (#23896) 2025-10-15 19:26:20 +05:30
satish
a37efedfa4
refactor: Domain and Data Product UI improvements and architecture enhancements (#23804)
* refactor: Domain and Data Product UI improvements and architecture enhancements

## Major Changes

### Architecture Improvements
- **Refactored AssetSelectionModal**: Split monolithic component into composable hooks
  - Extracted `useAssetSelectionContent` hook (806 lines) for shared selection logic
  - Created `AssetSelectionDrawer` component for drawer variant
  - Reduced main modal component from 700+ to 18 lines
  - Enables reuse across modal and drawer UI patterns

- **Domain component reorganization**:
  - Renamed `DomainDetailsPage` → `DomainDetails` for consistency
  - Deleted legacy `DomainPage.component.tsx` (336 lines)
  - Centralized domain page styles in `DomainPageStyles.ts`

### UI/UX Enhancements
- **Breadcrumbs**: Changed to plural labels across all pages
  - "Domain" → "Domains" in listings and detail pages
  - "Data Product" → "Data Products" in listings and detail pages
  - Updated sidebar navigation labels to match

- **Scroll behavior fixes**:
  - Removed fixed height constraints causing nested scrolls in right panels
  - Changed from `height: @domain-page-height` to `min-height: 70vh`
  - Applied to both Domain (domain.less) and Data Product (data-products-details-page.less) detail pages
  - Now uses single body scroll for better UX

- **Visual improvements**:
  - Added white text color to MUI tooltips for better contrast on black background
  - Enhanced GenericProvider with `muiTags` prop support
  - Added new `CoverImage` component for domain/data product headers
  - Improved `useBreadcrumbs` hook with 187 lines of enhancements

### Bug Fixes
- **TypeScript errors in NotistackUtils.tsx**:
  - Fixed implicit 'any' type for `snackbarId` parameters (4 instances)
  - Added type assertion for i18n.t() return value
  - All type errors resolved

### Component Improvements
- Enhanced TagsViewer with MUI tooltip support
- Updated TagChip component for better tag display
- Improved EntityAvatar component
- Refined drawer hooks with better type safety

* feat: Add cover image upload with reposition functionality for domains

- Add MUICoverImageUpload component with drag-and-drop support
- Implement vertical reposition functionality for cover images
- Integrate cover image field in AddDomainForm
- Update CoverImage component to support position object format
- Add COVER_IMAGE_UPLOAD_MUI field type to form utils
- Support empty entityLink for uploads during domain creation
- Add translations for cover image upload UI

🤖 Generated with [Claude Code](https://claude.com/claude-code)

Co-Authored-By: Claude <noreply@anthropic.com>

* feat: Add cover image display with authenticated loading and test IDs

- Update DomainDetails and DataProductsDetailsPage to pass cover image URL and position to CoverImage component
- Implement authenticated image loading with proper loading states in CoverImage component
- Add gray background during authenticated image loading to prevent 401 error flash
- Implement conditional rendering in MUICoverImageUpload to show loading spinner for authenticated images
- Add comprehensive data-testid attributes for both components to improve testability
- Use theme colors for loading backgrounds instead of hardcoded values

🤖 Generated with [Claude Code](https://claude.com/claude-code)

Co-Authored-By: Claude <noreply@anthropic.com>

* refactor: Implement generic cover image upload flow and remove dead code

- Create reusable createEntityWithCoverImage utility function
- Refactor domain, subdomain, and data product creation to use generic function
- Fix cover image preview and reposition functionality for client-side handling
- Remove unused AddDomain component and /domain/add route
- Remove dead DomainLeftPanel component
- Reduce code duplication by 77% (344 lines → 79 lines)
- Add proper TypeScript types and ESLint compliance

🤖 Generated with [Claude Code](https://claude.com/claude-code)

Co-Authored-By: Claude <noreply@anthropic.com>

* refactor: Update coverImage structure to match new backend API

- Update CoverImageUploadUtils to send coverImage as nested object
- Change from flat structure (coverImage: url, coverImagePosition: number)
- Change to nested structure (coverImage: { url: string, position: string })
- Update DomainDetails to read from nested coverImage object
- Update DataProductsDetailsPage to read from nested coverImage object
- Convert position between CSS string format ("20px") and pixel number (20)
- Fix DomainRouter test by removing deleted AddDomain component references
- Add type assertions for compatibility until backend types are regenerated

🤖 Generated with [Claude Code](https://claude.com/claude-code)

Co-Authored-By: Claude <noreply@anthropic.com>

* refactor: Use percentage-based positioning for cover images

Fix cover image display inconsistency between upload field (622x103px)
and detail page (auto x 131px) by using CSS percentage values for
translateY instead of absolute pixels. This ensures the same visual
result regardless of container width.

- Store position as percentage string (e.g., "-16%") instead of pixels
- Convert between pixels (for dragging UX) and percentage (for storage)
- Update CoverImagePosition interface to use string type
- Simplify detail page rendering by removing parseInt conversions

🤖 Generated with [Claude Code](https://claude.com/claude-code)

Co-Authored-By: Claude <noreply@anthropic.com>

* Fix ts error

* refactor: Extract generic file upload component from cover image upload

- Create MUIFileUpload component with drag-and-drop, validation, and preview support
- Refactor MUICoverImageUpload to use MUIFileUpload (33% code reduction)
- Add 20 i18n keys across all 18 languages for file upload features
- Fix TypeScript types and ESLint formatting issues
- Fix upload zone height to match preview at 103px

🤖 Generated with [Claude Code](https://claude.com/claude-code)

Co-Authored-By: Claude <noreply@anthropic.com>

* Revert entity-transfer-message change

* Update checkDefaultStateForNavigationTree for 2 domains tree and tree item

* Fix navigation page test

---------

Co-authored-by: Satish <satish@Satishs-MacBook-Pro.local>
Co-authored-by: Claude <noreply@anthropic.com>
2025-10-15 19:22:50 +05:30
Chirag Madlani
21b1c23512
test(e2e): restore entity with inherited fields on entity (#23266)
* test(e2e): restor entity with inherited fields on entity

* fix tests

* fix flakiness for table and dashboard
2025-10-15 14:59:25 +05:30
Ushran Gouhar
e5f8ea2925
Potential fix for code scanning alert no. 1692: Incomplete string escaping or encoding (#23895)
Co-authored-by: Copilot Autofix powered by AI <62310815+github-advanced-security[bot]@users.noreply.github.com>
2025-10-15 14:36:34 +05:30
Mayur Singal
3c527ca83b
MINOR: Fix Databricks DLT Pipeline Lineage to Track Table (#23888)
* MINOR: Fix Databricks DLT Pipeline Lineage to Track Table

* fix tests

* add support for s3 pipeline lineage as well
2025-10-15 10:54:01 +02:00
Ashish Gupta
14f5d0610d
remove unwanted semantic rule and supported more playwright test (#23864)
* remove unwanted semantic rule and supported more playwright test

* fix data product filter not working and added playwright test for it

* fix test and some sonar issue

* fix the sonar issue

* fix the timeout issue
2025-10-15 14:21:11 +05:30
sonika-shah
585d4c8d92
Support coverImage upload (#23863)
* Support coverImage upload

* Update generated TypeScript types

---------

Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
2025-10-15 14:19:59 +05:30
Bhanu Agrawal
546ee6bc63
Added streaming & caching for log download issue (#23703)
* Added streaming & chaching for log download issue

* py_lint

* py_lint

* addressed comments

* fixed github security vul

* Addressed github security bot reported issues

---------

Co-authored-by: SumanMaharana <sumanmaharana786@gmail.com>
2025-10-15 05:50:25 +00:00
Akash Verma
9b16119ab5
feat: Add Hex dashboard connector support (#23246)
* feat: Add Hex dashboard connector support

* files

* Added tests and UI image

* fix tests

---------

Co-authored-by: Akash Verma <akashverma@Mac.lan>
2025-10-15 11:05:42 +05:30
Ajith Prasad
84545efd3f
Team filter in Most Viewed Data Entities (#23884)
* Team filter in Most Viewed Data Entities

* Added TC

* create the constant USES_OWNER_FIELD_FOR_TEAM_FILTER
2025-10-15 09:04:18 +05:30
Sriharsha Chintalapani
8bff1e0faf
Modify title and creation date in openmetadata.ttl (#23894)
Updated the title and creation date in the OpenMetadata ontology.
2025-10-14 16:21:08 -07:00
Ushran Gouhar
63a8862e28
fix(ui): code scanning alert no. 1681: Insecure randomness #23886 (#23886) 2025-10-15 00:17:18 +05:30
Bhanu Agrawal
b39c08256c
Support all stemmer languages in OpenSearch index transformation (#23890) 2025-10-14 22:49:13 +05:30
Adrià Manero
86b6de3346
Fix duplicate tags in ChangeDescription by passing empty lists to recordListChange (#23841) 2025-10-14 17:44:41 +02:00
Bhanu Agrawal
650627a025
fix(nlq): Use dual-field search for owner queries to improve match rates (#23794) 2025-10-14 20:31:04 +05:30
Ushran Gouhar
582f9322ab
Potential fix for code scanning alert no. 1685: Incomplete string escaping or encoding (#23885)
Co-authored-by: Copilot Autofix powered by AI <62310815+github-advanced-security[bot]@users.noreply.github.com>
2025-10-14 18:07:31 +05:30
Shailesh Parmar
a7b54fed00
playwright: fix tier issue in playwright (#23883) 2025-10-14 18:02:12 +05:30
Sweta Agarwalla
dd307a43e0
fix(ui): Runner getting wrong values in workflow API (#23827)
* fix runner issues

* add unit tests for the fix
2025-10-14 17:13:55 +05:30
Ajith Prasad
f2a9dd0015
Fixes angus mail vulnerability issue (#23843) 2025-10-14 15:46:48 +05:30
Chirag Madlani
7a29bf1e2c
fix(test): customize details page and persona flow (#23839)
* fix(test): customize details page and persona flow

* revert playwright config
2025-10-14 15:27:21 +05:30
IceS2
7bdd9008ec
Fixes #23776 : Fix/data quality dashboard filtering (#23818)
* Fix Data Quality Dashboard Filtering

* Fix Data Quality Dashboard Filtering

* Fix Tier filter on DQ Dashboard

* Fix issue when tags are empty list

* Add Tier/Tag propagation to TestCaseResultIndex

* Add Tier/Tag propagation to TestCaseResultIndex

* Add Tier/Tag propagation to TestCaseResultIndex

* Add Tier/Tag propagation to TestCaseResultIndex

---------

Co-authored-by: Pere Miquel Brull <peremiquelbrull@gmail.com>
2025-10-14 11:30:10 +02:00
Mohit Tilala
09c851265e
[Redshift] Add better handling of incomplete redshift view definition (#23866)
* Add better handling of incomplete redshift view definition

* Match exact definitions in tests

* Correct isort on tests
2025-10-14 12:51:07 +05:30
Harsh Vador
a36eef1c84
Search refactoring updates (#23742)
* refactor searchQuery to avoid AND and OR operators

* fix searchQuery function

* fix serviceDetails.tsx

* refactor for searchQuery

* update searchData calls with searchQuery

* fix unit test

* refactor queryFilter for dataContractUtil.ts

* fix authProvider for global domain filter

* address PR comments

* revert dataProduct fqn change

* refactor all query filtersusing getTermQuery function

* fix test

* fix tests

* fix e2e tests

* fix test

* fix service listing

* fix test

* fix service spec

* fix glossary spec and tag spec

* fix domains spec

* fix tag spec

* fix failing specs

* fix failed specs

* fix failing tests

* fix domain spec

* fix classification & service listing spec

* change query filter for following & change message for no online users

* add missing followers field in entity index mapping

* add missing owners field in entity index mapping

* address comments

* fix failing test

---------

Co-authored-by: Pranita <pfulsundar8@gmail.com>
Co-authored-by: Akash Jain <15995028+akash-jain-10@users.noreply.github.com>
Co-authored-by: sonikashah <sonikashah94@gmail.com>
2025-10-14 10:30:52 +05:30
Sriharsha Chintalapani
949cc32eef
Fix user creation through openmetadata-ops.sh (#23879) 2025-10-14 09:19:17 +05:30
Harshit Shah
a3e5190f69
Playwright: Fix users.spec default persona test (#23820)
* Playwright: Fix users.spec default persona test

* minor fix

* minor fix

* minor fix
2025-10-13 21:03:07 +05:30
Keshav Mohta
50dbe6fe44
fix: view_names issue when incremental enabled (#23858) 2025-10-13 19:21:07 +05:30
IceS2
eb7dfdb28f
Fix #23849: search document update missing from incidents (#23861)
* Fix Data Quality Dashboard Filtering

* Fix Data Quality Dashboard Filtering

* Fix Tier filter on DQ Dashboard

* Fix issue when tags are empty list

* Add Tier/Tag propagation to TestCaseResultIndex

* Add Tier/Tag propagation to TestCaseResultIndex

* Add Tier/Tag propagation to TestCaseResultIndex

* Add Tier/Tag propagation to TestCaseResultIndex

* Fix Search Document Update missing from Incident PATH

* Fix Search Document Update for Incidents

* Revert unintended changes, keep only TestCaseResolutionStatusRepository fix
2025-10-13 15:18:38 +02:00
Ashish Gupta
73b4f77e2e
#23774 : fix the bulk import column name contains dot in it (#23791)
* fix the bulk import column name contains dot in it

* fix for name field

* fix the failing test

* fix the test failure
2025-10-13 17:43:21 +05:30
Mohit Yadav
8c02775b3b
Add Selective entity reindex for passed entity refs (#23828)
* Add Selective entity reindex for passed entity refs

* Add Timeouts

* Add admin check
2025-10-13 14:48:16 +05:30
Mayur Singal
a638bdcfe0
MINOR: Fix databricks pipeline repeating tasks issue (#23851) 2025-10-13 00:41:05 +05:30
Copilot
c8722faf47
Fix Grafana connector validation error for integer format fields (#23202)
* Initial plan

* Fix Grafana connector format field validation issue

- Update GrafanaTarget.format field to accept both str and int types
- Add field_validator to convert integer format codes to string equivalents
- Add comprehensive tests for format field validation scenarios
- Add test fixture with integer format fields that reproduces the original issue
- Ensure backwards compatibility with existing string format values

This resolves the issue where Grafana dashboards with integer format fields
(e.g., format: 0 instead of format: "table") were causing validation errors
and being skipped during ingestion.

Co-authored-by: ulixius9 <39544459+ulixius9@users.noreply.github.com>

* fix: GrafanaTarget model format type from str to Any

---------

Co-authored-by: copilot-swe-agent[bot] <198982749+Copilot@users.noreply.github.com>
Co-authored-by: ulixius9 <39544459+ulixius9@users.noreply.github.com>
Co-authored-by: Sriharsha Chintalapani <harshach@users.noreply.github.com>
Co-authored-by: Keshav Mohta <keshavmohta09@gmail.com>
2025-10-12 23:14:16 +05:30
harshsoni2024
c32a9b957f
Add AWS kinesis firehose connector [OSS] (#23807)
* AWS Firehose

* Add AWS Firehose

* add kinesis fireshose support

* remove unnecessary doc

* Update generated TypeScript types

* add connection doc, optional msg service name

* Update generated TypeScript types

---------

Co-authored-by: Sriharsha Chintalapani <harsha@getcollate.io>
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Ayush Shah <ayush@getcollate.io>
2025-10-12 08:27:13 -07:00
Ayush Shah
d71a47db1d
fix(kafkaconnect): update table search method to use search_in_any_service (#23852) 2025-10-12 20:02:12 +05:30
Bhanu Agrawal
3801525263
Introduce unified ES/OS client API + separate index management (#23425)
* Setup new client for ES/OS

* Migrated createIndex and addIndexAlias methods

* Migrated createAliases method to new ES/OS client

* Migrated updateIndex and deleteIndex methods

* Updated indexExists methods

* refactor: extract index management operations into dedicated manager classes

* Add tests for ElasticSearch and OpenSearch index managers

* chore: fix code style issues"

* Added integeration tests for ES/OS index manager

* Fix log level

* Fixed priority key mapping for test_case_result_index

* fix test to use field name in the query as domains.id not domain.id

* Fixed failing tests

* Set headers so 8.x client can work with 7.17x or higher server for ES

* Added OpenSearch compatible stemmer configuration

* Fix java code style

* Fixed java checkstyle issue

* Added support for 7.17.x backward compatibility

* Fixed failing tests

* Updated client availability checks in both index manager classes to use the consistent !isClientAvailable pattern

* Removed comment

* chore: Fix line formatting in Playwright test files

- Adjusted line length in Domains.spec.ts for better readability
- Fixed indentation and formatting in Lineage.spec.ts
- Added missing newline at end of files

* Added new line

* Migrated other index related methods and add tests
2025-10-12 02:35:56 +05:30
Sriharsha Chintalapani
ce3a9bd654
Kafka connect improvements (#23845)
* Kafka Connect Lineage Improvements

* Remove specific Kafka topic example from docstring

Removed example from the documentation regarding the earnin.bank.dev topic.

* fix: update comment to reflect accurate example for database server name handling

* fix: improve expected FQN display in warning messages for missing Kafka topics

* fix: update table entity retrieval method in KafkaconnectSource

* fix: enhance lineage information checks and improve logging for missing configurations in KafkaconnectSource

* Kafka Connect Lineage Improvements

* address comments; work without the table.include.list

---------

Co-authored-by: Ayush Shah <ayush@getcollate.io>
2025-10-11 22:26:14 +02:00
Sriharsha Chintalapani
5c638f5c8e
Databricks DLT pipelines parsing (#23848) 2025-10-11 22:25:43 +02:00
Ayush Shah
a90cacc93b
MINOR: fix Kafka connect CDC lineage (#23836) 2025-10-11 15:40:03 +05:30
Harsh Vador
d4a9381473
fix(users): resolve search input losing characters during typing (#23832)
* fix(users): resolve search input losing characters during typing

* add test

* remove unwanted props & optimize code

* fix code smell
2025-10-11 10:55:40 +05:30
Ashish Gupta
6ce7623ca7
modify some data contract rule and supported playwright (#23766)
* supported contract owner rule additional playwright

* added all operator test for owners

* supported addition test for description operator

* change the description value from empty quotes to undefined to get that removed from data asset and the validation should work correctly on this

* Adding actualCase keyword to team and user index mappings

* change the query to displayName search from the fqn and name for better validation

* change the owner rule to name and added domain playwright test

* Conditional Sensitive Case Normalising in Search Aggregation

* Remove to lower case introduced by accident

* push the actual case field setting

* added is condition with teams for owners

* Reverted the displayName.actualCase changes

* reverted the owner back to fqn and supported fqn value and displayOption

* set the default operator for description

* changes made as per comments

---------

Co-authored-by: Ram Narayan Balaji <ramnarayanb3005@gmail.com>
2025-10-10 22:53:36 +05:30
Teddy
1f8cf64dd4
chore: added python 3.12 to CI (#23835)
* chore: added python 3.12 to CI

* chore: changed py-test-skip to 3.12
2025-10-10 17:26:45 +02:00
Teddy
93e5ee8cb1
fix: url encode fqn when retrieving test case results in python sdk (#23834) 2025-10-10 17:25:33 +02:00
Copilot
7b1d687f2d
Move logs summary from side panel to header for full-width logs display (#22307)
* Initial plan

* Move logs summary from side panel to header for full-width logs

Co-authored-by: harshach <38649+harshach@users.noreply.github.com>

* fix(test): update test description to reflect header layout instead of right panel

Co-authored-by: karanh37 <33024356+karanh37@users.noreply.github.com>

* fix failing unit test

* Update the UI for LogsViewerPage

* Fix sonarcloud issues

---------

Co-authored-by: copilot-swe-agent[bot] <198982749+Copilot@users.noreply.github.com>
Co-authored-by: harshach <38649+harshach@users.noreply.github.com>
Co-authored-by: Aniket Katkar <aniketkatkar97@gmail.com>
Co-authored-by: karanh37 <33024356+karanh37@users.noreply.github.com>
Co-authored-by: shrushti2000 <shrushtipolekar@gmail.com>
2025-10-10 20:14:09 +05:30
Ashish Gupta
9286933d5c
chore(ui): refactor data contract spec test (#23741)
* chore(ui): fix data contract flaky test around contract tab not found

* modify the test to have their own table to run to avoid flakiness

* fix contract failing

* revert unwanted commit

* change the contract test admin page way

* fix the blank page issue after redirect
2025-10-10 18:57:04 +05:30
Ashish Gupta
8ccd879655
PLAYWRIGHT: fix activity feed mention flaky test (#23823) 2025-10-10 18:55:24 +05:30
Ajith Prasad
9d0a739c69
LDAP login issues fixed, added retry mechanism (#23690)
* LDAP login issues fixed, added retry mechanism

* Remove unwanted comments

* Addressed copilot comments

* Added integration TCs for ldap
2025-10-10 18:46:26 +05:30