* Update Classification Schema to include Governance Fields
* Removed Tags, Reviewers, Domain from Classification as they are needed and corrected tests
* Added Permission check for owners in Classification Resource Test
* Added LoadTags.ts generated from createClassificationSchema.json
* Only have my schema changes in the typescript files, ignore other changes.
---------
Co-authored-by: Mohit Yadav <105265192+mohityadav766@users.noreply.github.com>
* Fix Lineage/EntityRelationship mappings back to object
* Add displayName to the user when the user is created and displayName is not set
* remove UserResource related changes
---------
Co-authored-by: sonikashah <sonikashah94@gmail.com>
* Fix: Remove operations and glossaryTags from bulk asset add api
* Fix: Improved the test case
* addTagToAssets schema - Removed operations field in the payload
---------
Co-authored-by: Mohit Yadav <105265192+mohityadav766@users.noreply.github.com>
* Fix#21457: SearchIndexing: Limit of total fields [1000] has been exceeded
* Fix#21457: SearchIndexing: Limit of total fields [1000] has been exceeded
* Fix BulkItemException throwing back to the UI
* add upstreamLineage to all appropriate indexes
* Remove conflicting lines and clean up index mappings for api_collection and stored_procedure JSON files
---------
Co-authored-by: Mohit Yadav <105265192+mohityadav766@users.noreply.github.com>
Co-authored-by: Ayush Shah <ayush@getcollate.io>
* Fix#21502: TooManyNestedClauses: Query contains too many nested clauses; maxClauseCount is set to 4096 error in table_search_index for complex search queries in Opensearch
* Fix#21502: TooManyNestedClauses: Query contains too many nested clauses; maxClauseCount is set to 4096 error in table_search_index for complex search queries in Opensearch
* Update openmetadata-service/src/test/java/org/openmetadata/service/resources/search/SearchResourceTest.java
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
* fix mvn build
* fix checkstyle
* fix tests in SearchResourceTest
* fix tests in SearchResourceTest
* instead of wrapping baseQuery+functionScore in a new BoolQuery,use functionScore directly as the final query - avoid duplication of mult_match query
* add requestSchema fields in APIEndpointIndex, and remove array fields in searchSettings to use fuzzyfields avoiding clause explosion
* - Set fuzzyMaxExpansions/maxExpansions to 10 instead of default 50
- Turn off fuzziness (Fuzziness.ZERO) for `.ngram` fields
- Update QUERY_SYNTAX_PATTERN so only uppercase AND, OR, NOT are treated as boolean operators
* use non Fuzzy query for ngram Fields in QueryStringBuilder , remove duplication of query in should phrase
* add fuzzy/nonFuzzy Fields for each asset in searchSettings.json
* add fuzzy/nonFuzzy Fields for each asset in searchSettings.json
* update isFuzzyField function
* fix playwright
---------
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
Co-authored-by: sonikashah <sonikashah94@gmail.com>
Co-authored-by: sonika-shah <58761340+sonika-shah@users.noreply.github.com>
* Add PIICategoryTags and some utilities on top of them.
* Fix static-check
* Add test for fqn representation
* Add NEREntityGeneralTags.json from Collate
* Add test to check PIICategoryTags agree with the ones used by OM server
* Add LabelExtractor
* Fix style
* Add ignore superflous-parens for pylint
* Ass comment as per PR review
* Fix not-updated PII-IT
* Remove duplicated IT test for PII
---------
Co-authored-by: Pere Menal <pere.menal@getcollate.io>
Co-authored-by: Sriharsha Chintalapani <harshach@users.noreply.github.com>
* queryParams to the webhook request URL
* add activityThreadsRetentionPeriod in the DataRetentionApplication jsons
* clean up activity threads of type conversation
* Revert "clean up activity threads of type conversation"
This reverts commit e66ea8623be6aa1c5d07afdec04b4807eb21c7e7.
* Revert "add activityThreadsRetentionPeriod in the DataRetentionApplication jsons"
This reverts commit 4180be18a8d5e0d4fd4b3d4662df0532bb16dbed.
* deprecation: remove testCaseResults endpoint from testCaseResource
* fix: path in test e2e test
* fix: endpoint name to testCaseResults
* style: fix java linting
* Fix#21533 - Add a tool to openmetadata-ops.sh to delete orphaned relations
* Fix#21533 - Add a tool to openmetadata-ops.sh to delete orphaned relations
* Add exit 1 and make dry-run default
* Add exit 1 and make dry-run default
* Fix checkstyle
---------
Co-authored-by: Pere Miquel Brull <peremiquelbrull@gmail.com>
* Adding Data Insights Migrations to remove Stale Objects
* Adding Data Insights Migrations to remove Stale Objects
* Adding dettachment to ES ILM policy from Index and template
* Adding dettachment to ES ILM policy from Index and template
* Adding dettachment to ES ILM policy from Index and template
* Fix Checkstyle
* Moved migrations to 172
* Removed code that was left over on 171 migration
* Improve SearchClient error handling
* Add logic to handle WorkflowContext on Ingestion
* Revert base.py changes
* Removed comment
* Fix basedpyright complaints
* Make ContextManager automatically add its context to the PipelineStatus
* Small changes
* Only dump non-null keys
* Add Method to Filter Ingestion Pipeline based on Metadata
* Reduce the scope to filter only specifically on metadata->workflow->serviceName
* Fix#21430 : Tier tag not updating in search filters
* Fix#21430 : Tier tag not updating in search filters
* add tests
* test: add test for glossary term
* test: add test coverage for all entities
* fix tests
* fix tests
* fix: service entity tests
---------
Co-authored-by: Pranita <pfulsundar8@gmail.com>
Co-authored-by: Sriharsha Chintalapani <harshach@users.noreply.github.com>
* Bump ch.qos.logback:logback-core from 1.4.x to 1.5.13 in /openmetadata-service
* match logback-classic.version to logback-core.version
* upgrade dropwizard version to 4.0.14 and logback to 1.5.18
---------
Co-authored-by: Sriharsha Chintalapani <harshach@users.noreply.github.com>
* Issue-19251: Upgrade dropwizard to 4.x and Jetty to 11.x
* keep jdbi3.37.1 version for ConnectionAware functionality
* Code builds
* Merge with main and fix MCP
* Fix to make server run
* Tests fix
* JsonArray causing issue
* Fix WebSockets
* fix json2schema using jakarta instead of javax
* Fix patch tests
* Fix tests
* Register auditing subtypes in OpenmeteadataOperations
---------
Co-authored-by: mohitdeuex <mohit.y@deuexsolutions.com>
Co-authored-by: sonikashah <sonikashah94@gmail.com>
Co-authored-by: Mohit Yadav <105265192+mohityadav766@users.noreply.github.com>
* feat: prep for collate support
- Added support for delayed background jobs. This is to delete the support user after a while.
- added ScheduleType.OnlyManual for applications to support only manual triggers
- Added a four hour token expiration
- Allow a null trigger type in job data (not sure what it's for)
* added test for delayed job
* added type checking for enumCleanupArgs in navbar
* - added a support toten type
- added job handler for delete token
* fixed whitelist links
* patch OnlyManual apps
* Update openmetadata-spec/src/main/resources/json/schema/entity/applications/app.json
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
* added indexes for runAt
* use NO_JOB_SLEEP_SECONDS in background job test
* Fixed NavBar test
* removed backticls
* fix indexes
* change for support app
* fix tests
---------
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
Co-authored-by: Karan Hotchandani <33024356+karanh37@users.noreply.github.com>
Co-authored-by: karanh37 <karanh37@gmail.com>
Co-authored-by: Pere Miquel Brull <peremiquelbrull@gmail.com>
