Bhanu Agrawal
2fb34a9762
Migrate/es os maven hlrc removal ( #24283 )
...
* Setup new client for ES/OS
* Migrated createIndex and addIndexAlias methods
* Migrated createAliases method to new ES/OS client
* Migrated updateIndex and deleteIndex methods
* Updated indexExists methods
* refactor: extract index management operations into dedicated manager classes
* Add tests for ElasticSearch and OpenSearch index managers
* chore: fix code style issues"
* Added integeration tests for ES/OS index manager
* Fix log level
* Fixed priority key mapping for test_case_result_index
* fix test to use field name in the query as domains.id not domain.id
* Migrated createEntity and createEntities method
* Fixed failing tests
* Set headers so 8.x client can work with 7.17x or higher server for ES
* Added OpenSearch compatible stemmer configuration
* Fix java code style
* Fixed java checkstyle issue
* Added support for 7.17.x backward compatibility
* Fixed failing tests
* Migrated createTimeSeriesEntity and deleteEntity methods
* Refactor search client architecture with entity management abstraction
* Updated log level to ERROR form WARN
* deleteEntity method impl removed from ES client
* migrated deleteEntityByFields method to new es/os client
* migrated deleteEntityByFQNPrefix method to use new ES/OS client
* deleteEntityByFQNPrefix method removed
* Migrated deleteByScript method to new ES/OS client
* Removed deleteByScript method from SearchClient
* Migrated softDeleteOrRestoreEntity method to new ES/OS client
* Reverted BulkResponse static import
* Migrated softDeleteOrRestoreChildren method to new ES/OS client
* Migrated updateEntity method to new ES/OS client
* Migrated updateChildren method to new ES/OS client
* Removed unused methods
* Migrated getDocByID method to new ES/OS client
* Added info logging
* Fixed parsing issue while passing string doc
* Migrated updateEntityRelationship method to new ES/OS client
* Migrated reindexWithEntityIds method to new ES/OS client
* Added log to show error message for updateEntityRelationship
* Refactored entity manager methods
* Added async client, fixed null obj parsing issue
* Refactoring
* Refactored duplicate methods createEntity and createTimeSeriesEntity
* Added integration tests for ES/OS entity managers
* Updated client availability checks in both index manager classes to use the consistent !isClientAvailable pattern
* Removed comment
* chore: Fix line formatting in Playwright test files
- Adjusted line length in Domains.spec.ts for better readability
- Fixed indentation and formatting in Lineage.spec.ts
- Added missing newline at end of files
* Added new line
* Migrated other index related methods and add tests
* MIgrated updateByFqnPrefix and updateLineage and deleteByRangeQuery methods
* migrated deleteByRangeAndTerm method
* Added integration tests
* Migrated updateColumnsInUpstreamLineage and deleteColumnsInUpstreamLineage methods
* Migrated updateGlossaryTermByFqnPrefix method
* Removed unused method and updated error handling
* Migrated reindexEntities method to new ES/OS client
* Added integration tests for reindexEntities method
* Added interface and impl for generic methods migration
* added default impl
* Migrated deleteDataStream method
* Migrated deleteILMPolicy method
* Migrated deleteIndexTemplate method
* Migrated deleteComponentTemplate emthod
* migrated dettachIlmPolicyFromIndexes method
* migrated removeILMFromComponentTemplate method
* Migrated cluster metric methods
* Removed from ESClient/OSClient to GenericManager
* Migrated getSearchHealthStatus
* Add integration tests
* Migrated buildDIChart and fetchDIChartFields methods
* Migrated listDataInsightChartResult emthod
* Migrated getQueryCostRecords
* Migrated getSchemaEntityRelationship
* Added data insight aggregator tests
* Fixed failing tests
* Migrated aggregate method
* Migrated genericAggregation and aggregate methods
* Fixed failing data insight query
* Updated ref for OS aggregation manager
* Fixed issues with aggregations migration
* Fixed tests
* Migrated lineage methods
* fix aggregate api response
* Fixed aggregation response structure
* Migrated searchBySourceUrl and searchByField methods
* Migrated getEntityTypeCounts, listWithOffset and listWithDeepPagination methods
* Fix failing tests
* Fix tests
* Migrated searchWithDirectQuery method
* Migrated search and previewSearch methods
* Fix tests
* Migrated searchWithNLQ method
* Migrated searchEntityRelationship, searchDataQualityLineage and searchSchemaEntityRelationship methods
* Removed unused fields and methods
* Migrated bulk ES/OS methods
* Migrated DataInsightProcess ES/OS
* Migrated ES/OS bulk and index sinks
* Remove unused search methods
* Removed deprecated HLRC for ES/OS
* Removed maven HLRC ES/OS client
* Fixed collate compile issues
* Fixed collate compile issues
* Fix nested should
* Fix for failing playwright tests
---------
Co-authored-by: Mohit Yadav <105265192+mohityadav766@users.noreply.github.com>
2025-11-13 14:21:35 +05:30
Shrushti Polekar
eebd3bb661
Feat(ui): SSO configuration from UI and Scim bot token generate revoke functionality and Group Mapping in settings page ( #21839 )
...
* added scim bot generate revoke token functionality on settings page
* update global setting constant
* minor code refactor
* WIP: SSO Configuration from UI
* Update generated TypeScript types
* Copilot suggestions addressed
* Test Endpoint added
* Added update security configuration test
* added sso configuration rjsf form
* minor fixes
* Update generated TypeScript types
* update scim component
* Fix Merge Conflicts
* Remove extra comma
* update sso form for oidc client providers
* SAML configuration fixes
* Update generated TypeScript types
* Update generated TypeScript types
* add support for selective schema generation by file name
* fix acces token card issue and array fields ui issue
* Saml registration fix
* Scim configuration saved
* refactor code
* scim config issues fixed
* fix enableSelfSignup
* scim enabling from settings
* Test validation enpoint changes
* fix ldap issues
* minor refactor
* minor updates
* update settings call for scim
* update bot details in scim card
* minor style fixes
* Adding enhanced validators
* update confidential client configurations
* Auth0 validator
* update jwt for saml
* Saml validator changes
* Okta validator fix
* fix saml certificate formatting and select widgets
* remove client type from ui for ldap and saml
* Okta validation rectified
* Google validator improved
* update select component
* fix error messages
* added unit test
* Azure validator rectified
* Validation issues solved for auth0
* add oidc prefix for oidc client fields
* fix type issues
* style fixes for scim token card
* Update cognito validator
* refactor file names
* added e2e tests
* minor fixes
* added content for docs in md files
* implement new design
* form style updates
* fix doc styles and provider selection styles
* fix provider selection style
* update local file
* group client fields together
* added provider name
* overview tab changes
* update form styles for configure tab
* update toggle styles
* update breadcrumb texts and provider name in text
* minor fix in localization
* minor fix for basic provider
* update breadcrumb styles and minor local file update
* minor fixes
* minor fix for local file
* fix styles for configured form
* minor fixes in styles
* fix redirect issue of my-data for non oidc sso
* fix build issue and refactor code
* update saml and ldap icons
* minor updates in icon
* typo fix
* breadcrumb and style fixes
* fix test
* update patch call
* minor fixes for access token card and code refactor
* refactor code to remove unused files
* added ldap and custom oidc doc content
* fix overview tab issue for scim and enable sso
* Patch issue fixed for authentication Configuration
* Implement unified authentication endpoints across all providers
* Memory leak issue solved
* Mcp md file
* apply spotless
* Added complete flow test for oidc
* refactor css files
* minor style updates
* cancel form functionality
* update placeholders
* update cancel modal
* minor update for saving existing config
* fix minor css issue
* integrate unified api
* remove clientid and callbackurl for confidential client type and added jwtPrincipalClaimsMapping
* fix breadcrumb issue
* refactor files and folder structure
* minor fix
* refactor code and add disable fields styles and cancel btn functionality for existing sso
* added localization file changes
* Patch operation issue fixed
* Update generated TypeScript types
* update patch call
* patch call update for enable self signup
* remove enable selfsignup from then form since its present in the toggle
* added enable self signup field for non existing sso form
* minor code revert for enabling fields
* Update generated TypeScript types
* Redirect uri, password encoding fixes for basic and ldap
* refactor code and encode password and added /auth/callback in redirecturl
* minor fixes
* added group mapping
* cancel modal save btn fix and logout fix
* minor fix for save btn functionality for cancel modal
* minor update in localization file
* address pr comments for ssoconfigform and css file names
* address pr comments for sso doc panel
* address pr comments around provider selector
* fix breadcrumb
* update localization file and remove unwanted files
* address pr comments related to basic auth provider
* extracted proxy code into separate func and added dev mode check
* remove unnecessary validate call happening during patch calls
* address pr comment related to tab
* update sso icon
* minor fix
* address parseSchema related pr comment
* address pr comment related to config fields constants
* added default value for callback url
* added default value for response type and clientAuthenticationMethod
* minor fix for callback url
* minor style fix
* Changed response to json for basic and ldap login
* revert unified api changes done for basic login
* made admin principal as required
* fix playwright for llogin test failure
* fix failing unit test
* fix login e2e test
* refresh call
* fix failing unit test
* fix unit test
* fix test
* remove setRefreshToken
* added default values for google
* minor style fixes
* minor text update
* Google credential validation, scope validation
* Discovery uri validation added with Auth0
* Discovery uri check added for okta
* minor style fixes
* minor checkbox fix
* minor required field fix
* minro fix
* AWS cognito validator
* google api depdendency added
* Update generated TypeScript types
* minor fixes
* minor fix for array fields cursor style issue
* Modified saml validator
* Admin principal respected while logging in
* Added tests for validators
* callback url update
* custom oidc validator
* added default values for saml
* custom oidc fix
* Saml validator issue solved
* Custom oidc publickeyurl validation
* validation for prompt
* test fix
* fix test
* TC fixed
* mvn spotless apply
* Addressed review comments
* Static method issue in Security COnfiguration manager fixed
---------
Co-authored-by: aji-aju <ajithprasad770@gmail.com>
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Mohit Yadav <105265192+mohityadav766@users.noreply.github.com>
Co-authored-by: mohitdeuex <mohit.y@deuexsolutions.com>
Co-authored-by: Chirag Madlani <12962843+chirag-madlani@users.noreply.github.com>
Co-authored-by: Ajith Prasad <37380177+aji-aju@users.noreply.github.com>
2025-09-23 13:23:46 +05:30
Mohit Yadav
455d9cd68c
Added better Searching via Claude tool ( #23343 )
2025-09-12 18:55:24 +05:30
Mohit Yadav
ae71cf4501
Fix Metadata Tool ( #23175 )
2025-09-01 14:02:55 +05:30
Mohit Yadav
414a009474
Upgrade Mcp to 0.11.2 ( #23049 )
...
* Upgrade Mcp to 0.11.2
Use stateless Mcp Servlet
* Add Test for Load Testing and Improve Search Response
* Fixed Glossary And Patch Test
* Add user tests
* Fix failing load test
2025-08-22 22:42:47 +05:30
Mohit Yadav
c0d7a574d7
chore(release): Prepare Branch for 1.10.0-SNAPSHOT ( #23034 )
...
Co-authored-by: github-actions <41898282+github-actions[bot]@users.noreply.github.com>
2025-08-21 21:43:01 +05:30
Mohit Yadav
e40210f137
Fix Vulnerabilities ( #22805 )
2025-08-07 10:59:29 +05:30
Mohit Yadav
b92e9d0e06
chore(release): Prepare Branch for 1.9.0-SNAPSHOT ( #22742 )
...
Co-authored-by: github-actions <41898282+github-actions[bot]@users.noreply.github.com>
2025-08-04 20:00:25 +05:30
Dmitriy
32e355460f
Fixes #22596 : MCP SearchMetadataTool "Failed to find index table" error with clusterAlias ( #22597 )
...
* ISSUE-22596: Fix search alias resolution with clusterAlias configuration
**Problem:**
MCP SearchMetadataTool was failing with "Failed to find index table" error
in production environments when clusterAlias is configured, while working
correctly in development environments without clusterAlias.
**Root Cause:**
- SearchMetadataTool was directly using entity alias names (e.g., "table")
without applying the clusterAlias transformation
- When clusterAlias is configured, both search indices and their aliases
are created with the cluster prefix
- Without this transformation:
- Development: "table" alias exists ✅
- Production: only "openmetadata_table" alias exists, "table" doesn't ❌
**Solution:**
- Apply SearchRepository.getIndexOrAliasName() transformation to respect clusterAlias
- This ensures the correct alias name is used ("table" → "openmetadata_table" in production)
- Add enhanced logging to track alias name resolution
**Testing:**
- Added unit tests covering scenarios with and without clusterAlias
- Verified fix resolves production issue with clusterAlias="openmetadata"
**Impact:**
- Fixes MCP search functionality in production environments using clusterAlias
- No breaking changes to existing functionality
- Maintains backward compatibility with environments without clusterAlias
Closes #ISSUE-22596
* ISSUE-22596: Clean up SearchMetadataToolTest: remove unused imports and redundant comments
---------
Co-authored-by: dmitrii.cherkashin <dmitrii.cherkashin@welltory.com>
Co-authored-by: Sriharsha Chintalapani <harshach@users.noreply.github.com>
Co-authored-by: Mohit Yadav <105265192+mohityadav766@users.noreply.github.com>
2025-07-28 18:53:46 +05:30
Mohit Yadav
9835533ee5
Fix Patch Tool ( #22222 )
...
Co-authored-by: Sriharsha Chintalapani <harshach@users.noreply.github.com>
2025-07-08 13:28:13 -07:00
Mohit Yadav
4db9bd063c
Added Virtual Threads and Semaphore to control ( #22198 )
...
Co-authored-by: Sriharsha Chintalapani <harshach@users.noreply.github.com>
2025-07-08 10:45:29 +05:30
Sriharsha Chintalapani
b461eeb881
Move MCP into separate maven module ( #22043 )
...
* Move MCP into separate maven module
* Fix styling
* Add Tests, upgrade to 0.10 mcp-sdk version
* Fix tests
* revert npm package and related files
---------
Co-authored-by: Chirag Madlani <12962843+chirag-madlani@users.noreply.github.com>
2025-07-01 12:02:29 -07:00
