* Fix: Search Slowness when painless scripts aggregates for terms and classifications
* Fix Sql
* Add fields to security service index
---------
Co-authored-by: mohitdeuex <mohit.y@deuexsolutions.com>
* Search Query for Tags to restrict tags other than Approved or Unprocessed
* Restrict tag search query in the UI to not show tags other than Approved/UnProcessed
* Fxi Search Queries for Tag Search and use protected for tests
* add activity feed
* Refactored the error message of validation, refactored code
* use generic widgets in data product details
* Update generated TypeScript types
* commit progress
* add activity feed to domains
* commit progress
* add status badge
* commit progress
* Add customizable layout for tag class base
* nit
* Fix data product reviewer fetch
* Add reviewer field in tag page
* Add knowledge center task route for notification
* fix knowledge center page enum
* nit
* Fix tag page unit test
* fix test
* fix expert field visiable issue
* fix expert field
* Fix tag and add domain entity test
* nit
* fix test is for domain add
* fix tags owner test id
* fix tag disabled permission issue
* Add Conversation feature for Data Products
* Update generated TypeScript types
* Merge branch 'main' into entity-specific-restrictions
* nit
* fix glossary integration test
---------
Co-authored-by: Karan Hotchandani <33024356+karanh37@users.noreply.github.com>
Co-authored-by: karanh37 <karanh37@gmail.com>
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Anujkumar Yadav <anujf0510@gmail.com>
Co-authored-by: Shailesh Parmar <shailesh.parmar.webdev@gmail.com>
* fix contract old schema column not visible on schem form while edit
* fix the unit test failing
* show column status, represent which column is being failed and passed
* fix the dropdown scrolling with screen and fix sonar issue as well
* Initial implementation for Dimensionality on Data Quality Tests
* Fix ColumnValuesToBeUnique and create TestCaseResult API
* Refactor dimension result
* Initial E2E Implementation without Impact Score
* Dimensionality Thin Slice
* Update generated TypeScript types
* Update generated TypeScript types
* Removed useless method to use the one we already had
* Fix Pandas Dimensionality checks
* Remove useless comments
* Implement PR comments, fix Tests
* Improve the code a bit
* Fix imports
* Implement Dimensionality for ColumnMeanToBeBetween
* Removed useless comments and improved minor things
* Implement UnitTests
* Fixes
* Moved import pandas to type checking
* Fix Min/Max being optional
* Fix Unittests
* small fixes
---------
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
* Setup new client for ES/OS
* Migrated createIndex and addIndexAlias methods
* Migrated createAliases method to new ES/OS client
* Migrated updateIndex and deleteIndex methods
* Updated indexExists methods
* refactor: extract index management operations into dedicated manager classes
* Add tests for ElasticSearch and OpenSearch index managers
* chore: fix code style issues"
* Added integeration tests for ES/OS index manager
* Fix log level
* Fixed priority key mapping for test_case_result_index
* fix test to use field name in the query as domains.id not domain.id
* Migrated createEntity and createEntities method
* Fixed failing tests
* Set headers so 8.x client can work with 7.17x or higher server for ES
* Added OpenSearch compatible stemmer configuration
* Fix java code style
* Fixed java checkstyle issue
* Added support for 7.17.x backward compatibility
* Fixed failing tests
* Migrated createTimeSeriesEntity and deleteEntity methods
* Refactor search client architecture with entity management abstraction
* Updated log level to ERROR form WARN
* deleteEntity method impl removed from ES client
* migrated deleteEntityByFields method to new es/os client
* migrated deleteEntityByFQNPrefix method to use new ES/OS client
* deleteEntityByFQNPrefix method removed
* Migrated deleteByScript method to new ES/OS client
* Removed deleteByScript method from SearchClient
* Migrated softDeleteOrRestoreEntity method to new ES/OS client
* Reverted BulkResponse static import
* Migrated softDeleteOrRestoreChildren method to new ES/OS client
* Migrated updateEntity method to new ES/OS client
* Migrated updateChildren method to new ES/OS client
* Removed unused methods
* Migrated getDocByID method to new ES/OS client
* Added info logging
* Fixed parsing issue while passing string doc
* Migrated updateEntityRelationship method to new ES/OS client
* Migrated reindexWithEntityIds method to new ES/OS client
* Added log to show error message for updateEntityRelationship
* Refactored entity manager methods
* Added async client, fixed null obj parsing issue
* Refactoring
* Refactored duplicate methods createEntity and createTimeSeriesEntity
* Added integration tests for ES/OS entity managers
* Updated client availability checks in both index manager classes to use the consistent !isClientAvailable pattern
* Removed comment
* chore: Fix line formatting in Playwright test files
- Adjusted line length in Domains.spec.ts for better readability
- Fixed indentation and formatting in Lineage.spec.ts
- Added missing newline at end of files
* Added new line
* Migrated other index related methods and add tests
* MIgrated updateByFqnPrefix and updateLineage and deleteByRangeQuery methods
* migrated deleteByRangeAndTerm method
* Added integration tests
* Migrated updateColumnsInUpstreamLineage and deleteColumnsInUpstreamLineage methods
* Migrated updateGlossaryTermByFqnPrefix method
* Removed unused method and updated error handling
* Migrated reindexEntities method to new ES/OS client
* Added integration tests for reindexEntities method
* Added interface and impl for generic methods migration
* added default impl
* Migrated deleteDataStream method
* Migrated deleteILMPolicy method
* Migrated deleteIndexTemplate method
* Migrated deleteComponentTemplate emthod
* migrated dettachIlmPolicyFromIndexes method
* migrated removeILMFromComponentTemplate method
* Migrated cluster metric methods
* Removed from ESClient/OSClient to GenericManager
* Migrated getSearchHealthStatus
* Add integration tests
* Migrated buildDIChart and fetchDIChartFields methods
* Migrated listDataInsightChartResult emthod
* Migrated getQueryCostRecords
* Migrated getSchemaEntityRelationship
* Added data insight aggregator tests
* Fixed failing tests
* Fixed failing data insight query
* Fixed issue with FQN json data
* Fix: Fixed the description highlight issue in the explore page
* Test: Added unit test for description highlight bug fix
* Fix: revert code
* Fix: Fixed the code smell
* Remove data placed in the wrong directory
* Update `MigrationUtil` to use data from `piiTagsWithRecognizers`
That way we can also remove duplicate json and have a single source of data
* Update migration queries to use prepared statements
* Minor fix in the `piiTagsWithRecognizers` definitions
* feat: Add test case for user assignment persistence after user deletion
- Add test_userAssignmentPersistsAfterUserDeletion method
- Creates user, assigns to test case incident, deletes user
- Verifies user assignment persists after deletion
- Covers functionality from PR #21314🤖 Generated with [Claude Code](https://claude.ai/code)
Co-authored-by: Teddy <TeddyCr@users.noreply.github.com>
* fix: Update test to verify user assignment is removed after user deletion
- Changed test name from test_userAssignmentPersistsAfterUserDeletion to test_userAssignmentRemovedAfterUserDeletion
- Modified assertions to verify user is no longer assigned to incident after deletion
- Added proper handling for cases where assignee is null or status type changes
Co-authored-by: Teddy <TeddyCr@users.noreply.github.com>
* fix: Apply Java code formatting for checkstyle compliance
Co-authored-by: Teddy <TeddyCr@users.noreply.github.com>
* style: ran java linting
* fix: implement tests
* fix: handle assigned incidents on user deletion
* fix: wildcard import
* fix: use AsyncService singleton for async exec
* fix: wildcard import
---------
Co-authored-by: claude[bot] <209825114+claude[bot]@users.noreply.github.com>
Co-authored-by: Teddy <TeddyCr@users.noreply.github.com>
* feat: add owner assignment support at metadata ingestion level
* docs: Translate comments to English in test_owner
* refactor: move the test_owner-related files into correct positions
* feat: Add support for more source types
* Revert "feat: Add support for more source types"
This reverts commit a7649dcb3204cf98b7f4f9be02fbb982d2532193.
* feat: Add owner field support in sourceConfig for Database and Dashboard ingestion (fixes#22392)
* refactor code with the required style
* add owner field in related json file
* feat: add topology-based owner config for database/schema/table
* Format the code by the pre-commit tools
* fix some errors
* add a doc to explain this feature
* translate all Chinese comments to English and consolidate documentation
* remove redundant code
* refactor code
* refactor code
* refactor code
* refactor code
* Add some tests for owner-config and enhance this feat
* Add some tests for owner-config and enhance this feat
* fix some error
* fix some error
* refactor code
* Remove the yaml and bash test files and test owner config with pytest style
* format the python code
* refactor ingestion code
* refactor code
* fix some error in test_owner_utils
---------
Co-authored-by: Ma,Yutao <yutao.ma@sap.com>
* Initial implementation for Dimensionality on Data Quality Tests
* Fix ColumnValuesToBeUnique and create TestCaseResult API
* Refactor dimension result
* Initial E2E Implementation without Impact Score
* Dimensionality Thin Slice
* Update generated TypeScript types
* Update generated TypeScript types
* Removed useless method to use the one we already had
* Fix Pandas Dimensionality checks
* Remove useless comments
* Implement PR comments, fix Tests
* Improve the code a bit
* Fix imports
---------
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
* refactor: remove testCaseSummary prop from TableProfiler components and related interfaces
* feat: add Data Observability Tab component and integrate into TableUtils
* feat: add TabFilters component and integrate with DataObservabilityTab; update styles and replace no-data icon
* feat: enhance NoProfilerBanner with improved layout and styling; add SummaryCardV1 component and update translations
* feat: add new SVG icons for add-item, red-circle-with-dash, success-ticket, and yellow-calendar; update SummaryCardV1 to support icon and extra props
* feat(ui): Refactor DataObservabilityTab and SummaryCardV1 for improved styling and layout
* remove commented code
* feat(ui): Update Profiler components for improved styling and functionality
* feat(ui): Enhance ProfilerDetailsCard chart axes styling
* feat(ui): Update color constants and enhance Profiler components with new tooltip and chart features
* feat(ui): Enhance Profiler components with new metrics, improved styling, and additional color constants
* feat(ui): Enhance Profiler components with additional props and improve layout using Grid
* feat(ui): Enhance Data Observability components with new features, improve layout, and integrate test case result aggregation
* feat(ui): Refactor Table Profiler to enhance test case summary handling and improve data quality metrics display
* fix: improve application robustness and UI consistency
- Set default value for plugins in AppRouter to prevent potential errors.
- Add conditional rendering for ProfilerLatestValue to avoid rendering issues when props are undefined.
- Make profilerLatestValueProps optional in ProfilerStateWrapper interface for better flexibility.
- Refactor ColumnProfileTable to remove unused imports and optimize rendering logic.
- Replace Button with Typography for better styling in ColumnProfileTable.
- Update SingleColumnProfile to use Stack for layout consistency and include ColumnSummary when available.
- Enhance CardinalityDistributionChart and DataDistributionHistogram with new styling and layout using MUI components.
- Introduce DataPill styled component for consistent data display.
- Update color constants for improved visual consistency across charts.
- Modify data insight tooltip to conditionally display date in header for better clarity.
* refactor: update UI components for improved styling and layout consistency
* minor fix
* feat: Enhance column profiling with data quality test metrics and visualizations
* feat: Remove SummaryPanel component and tests; replace with SummaryCardV1 in QualityTab
* feat: Refactor QualityTab component layout and enhance test case filtering options
* feat: Enhance QualityTab with search and filter options; refactor DataQualityTab and update styles
* feat: Refactor theme creation and integrate global styles
- Updated createMuiTheme.ts to improve theme structure and organization.
- Added GlobalStyles to App.tsx for consistent font sizing across the application.
- Introduced InlineTestCaseIncidentStatus component for better handling of test case statuses.
- Modified TestCaseIncidentManagerStatus to conditionally render InlineTestCaseIncidentStatus based on props.
- Enhanced DataQualityTab to include a new column for failed/aborted reasons and last run timestamps.
- Updated QualityTab to streamline pagination handling and improve layout.
- Added isInline prop to TestCaseStatusIncidentManagerStatus interface for inline rendering.
* feat: Enhance InlineTestCaseIncidentStatus component with user search and improved UI elements
* feat: Introduce RequiredLabel component for consistent required field styling
* refactor: remove incident column rendering logic from DataQualityTab component
* border style update
* feat: Implement action menu for test case editing and deletion in DataQualityTab
* fix: Correct percentage calculation for null, unique, and distinct proportions in ColumnProfileTable
* fix: Update border color in IncidentManager component for improved visibility
* feat: add InlineSeverity component and integrate it into Severity component
* fix: update font weight for consistency across components
* Refactor Profiler Tab Navigation and Update Related Components
- Replaced TableProfilerTab enum with ProfilerTabPath for better URL path management in the Profiler components.
- Updated DataQualityTab, ColumnProfileTable, and other related components to use the new ProfilerTabPath for navigation.
- Removed unnecessary QueryString imports and refactored navigation logic to streamline URL handling.
- Adjusted tests and utility functions to align with the new tab structure.
- Deleted obsolete TableProfiler component and its associated tests to clean up the codebase.
* Refactor tests to use global MUI mock and update assertions
- Introduced a global mock for Material-UI components to resolve Jest compatibility issues.
- Updated various test files to import the new MUI mock.
- Adjusted assertions in tests to reflect changes in component structure and behavior.
- Added default selected range and epoch time mocks in relevant utility tests.
- Refactored test cases to improve readability and maintainability.
* Add copyright notices and update localization strings
- Added Apache License 2.0 copyright notices to multiple files including TabFilters.tsx, data-observability-tab.less, no-profiler-banner.less, single-column-profiler.less, and SummaryCardV1.tsx.
- Updated localization files (de-de.json, en-us.json, es-es.json, fr-fr.json, gl-es.json, he-he.json, ja-jp.json, ko-kr.json, mr-in.json, nl-nl.json, pr-pr.json, pt-br.json, pt-pt.json, ru-ru.json, th-th.json, tr-tr.json, zh-cn.json, zh-tw.json) to include new keys for pluralized test types and updated messages for profiler insights.
- Added debug.json to .gitignore to prevent tracking of Jest Sonar Reporter debug files.
* Enhance NoProfilerBanner component with data-testid attributes and update related tests
* Refactor TabFilters and ColumnPickerMenu components to use MUI components, add MuiDatePickerMenu, and implement date range utilities
* Refactor date range handling in TabFilters, ColumnProfileTable, and SingleColumnProfile components; update IncidentManager to conditionally render date range picker
* Refactor TabFilters to use getDefaultTabKey for activeTab; clean up unused imports in ProfilerClassBase
* Refactor: Update Profiler tests to use i18n for labels and mock location
* Refactor: Replace Modal with Drawer for Profiler Settings and enhance styling
* Refactor: Update component styles and improve chart rendering logic
* refactor: Replace menuitem role with tab role for improved accessibility in Data Quality tests
* refactor: Add createHorizontalGridLineRenderer mock to chart component tests
* refactor: Update role attributes for accessibility and enhance styling in Data Quality tab
* refactor: Enhance test case interactions and improve UI element accessibility in Incident Manager and Data Quality tests
* refactor: Adjust drawer width in ProfilerSettingsModal for improved layout
* refactor: Update Legend component to use rectangular icons for improved clarity
* refactor: Adjust width of Y-axis based on category visibility in ProfilerDetailsCard
* Add TabFilters component tests and MuiDatePickerMenu implementation
- Created a new test file for the TabFilters component with comprehensive tests covering rendering, permissions, URL parameters, and accessibility.
- Implemented the MuiDatePickerMenu component with an interface for props and added tests to ensure correct functionality and rendering.
- Enhanced the mock for MUI components to include Menu and MenuItem for better testing of dropdown interactions.
- Updated the MuiDatePickerMenu to utilize the new interface for improved type safety and maintainability.
* refactor: Consolidate severity and status color constants, update related components and interfaces
* feat: Add new SVG icons for data quality states and update references in components
* Extend `metadata.sdk.configure` function
* Create convenience classes for existing `TestDefinition`s
* Create `WorkflowConfigBuilder` for data quality
* Create `ResultCapturingProcessor` for data quality
This is so we can intercept results from `TestCaseRunner` and return results to the calling application
* Implement `TestRunner` interface to run test cases as code
* Add an example of the simplified API
Also, fix some static checks errors in `builder_end_to_end.py`
* Setup new client for ES/OS
* Migrated createIndex and addIndexAlias methods
* Migrated createAliases method to new ES/OS client
* Migrated updateIndex and deleteIndex methods
* Updated indexExists methods
* refactor: extract index management operations into dedicated manager classes
* Add tests for ElasticSearch and OpenSearch index managers
* chore: fix code style issues"
* Added integeration tests for ES/OS index manager
* Fix log level
* Fixed priority key mapping for test_case_result_index
* fix test to use field name in the query as domains.id not domain.id
* Migrated createEntity and createEntities method
* Fixed failing tests
* Set headers so 8.x client can work with 7.17x or higher server for ES
* Added OpenSearch compatible stemmer configuration
* Fix java code style
* Fixed java checkstyle issue
* Added support for 7.17.x backward compatibility
* Fixed failing tests
* Migrated createTimeSeriesEntity and deleteEntity methods
* Refactor search client architecture with entity management abstraction
* Updated log level to ERROR form WARN
* deleteEntity method impl removed from ES client
* migrated deleteEntityByFields method to new es/os client
* migrated deleteEntityByFQNPrefix method to use new ES/OS client
* deleteEntityByFQNPrefix method removed
* Migrated deleteByScript method to new ES/OS client
* Removed deleteByScript method from SearchClient
* Migrated softDeleteOrRestoreEntity method to new ES/OS client
* Reverted BulkResponse static import
* Migrated softDeleteOrRestoreChildren method to new ES/OS client
* Migrated updateEntity method to new ES/OS client
* Migrated updateChildren method to new ES/OS client
* Removed unused methods
* Migrated getDocByID method to new ES/OS client
* Added info logging
* Fixed parsing issue while passing string doc
* Migrated updateEntityRelationship method to new ES/OS client
* Migrated reindexWithEntityIds method to new ES/OS client
* Added log to show error message for updateEntityRelationship
* Refactored entity manager methods
* Added async client, fixed null obj parsing issue
* Refactoring
* Refactored duplicate methods createEntity and createTimeSeriesEntity
* Added integration tests for ES/OS entity managers
* Updated client availability checks in both index manager classes to use the consistent !isClientAvailable pattern
* Removed comment
* chore: Fix line formatting in Playwright test files
- Adjusted line length in Domains.spec.ts for better readability
- Fixed indentation and formatting in Lineage.spec.ts
- Added missing newline at end of files
* Added new line
* Migrated other index related methods and add tests
* MIgrated updateByFqnPrefix and updateLineage and deleteByRangeQuery methods
* migrated deleteByRangeAndTerm method
* Added integration tests
* Migrated updateColumnsInUpstreamLineage and deleteColumnsInUpstreamLineage methods
* Migrated updateGlossaryTermByFqnPrefix method
* Removed unused method and updated error handling
* Migrated reindexEntities method to new ES/OS client
* Added integration tests for reindexEntities method
* Added interface and impl for generic methods migration
* added default impl
* Migrated deleteDataStream method
* Migrated deleteILMPolicy method
* Migrated deleteIndexTemplate method
* Migrated deleteComponentTemplate emthod
* migrated dettachIlmPolicyFromIndexes method
* migrated removeILMFromComponentTemplate method
* Migrated cluster metric methods
* Removed from ESClient/OSClient to GenericManager
* Migrated getSearchHealthStatus
* Add integration tests
* Refactor recognizer migration for 1.11.0
This is because in a previous PR I had added this migration without following the standard pattern for Java migrations using `MigrationUtil`s
* Remove seed data for tags without recognizers
* fix: Clean up MUI form component theme overrides and fix component consistency
- Remove redundant MUI default overrides from form theme
- Fix Select focus border styling (notchedOutline border: 0)
- Ensure consistent 40px height for TextField, Select, and Autocomplete (size="small")
- Add MuiAutocomplete dropdown shadow to match Select dropdown
- Update TreeSearchInput to match MUI Autocomplete behavior exactly:
- Apply MUI's exact padding values for root and input
- Use absolute positioning for clear icon (endAdornment)
- Implement hover/focus visibility for clear icon
- Use literal pixel values for chip margins (2px/3px)
- Fix MUITagSuggestion type guards and prop sorting
- Replace all 'any' types with proper TypeScript types
- Fix all ESLint errors (prop sorting, unused vars, type safety)
All changes pass TypeScript compilation and ESLint with zero errors/warnings.
🤖 Generated with [Claude Code](https://claude.com/claude-code)
Co-Authored-By: Claude <noreply@anthropic.com>
* refactor: Replace hardcoded fontSize values with typography constants in navigation-theme
- Import BODY_FONT_SIZES from typography-constants
- Replace '1rem' with BODY_FONT_SIZES.BODY2 (14px) in:
- MuiTab
- MuiPaginationItem
- MuiMenuItem
- MuiTablePagination (selectLabel, displayedRows, select)
- Replace '12px' with BODY_FONT_SIZES.CAPTION in MuiBreadcrumbs separator
- Replace '14px' with BODY_FONT_SIZES.BODY2 in MuiLink
Benefits:
- Consistent typography across theme files
- Single source of truth for font sizes
- Easier maintenance and global adjustments
🤖 Generated with [Claude Code](https://claude.com/claude-code)
Co-Authored-By: Claude <noreply@anthropic.com>
---------
Co-authored-by: Satish <satish@Satishs-MacBook-Pro.local>
Co-authored-by: Claude <noreply@anthropic.com>
* Fix Lineage Service Issue
* Revert "Fix Lineage Service Issue"
This reverts commit f74512a5eed8013bc22b2ee1ea1247e9ec3c19e4.
* Use Data asset for lineage
