* Add PIICategoryTags and some utilities on top of them.
* Fix static-check
* Add test for fqn representation
* Add NEREntityGeneralTags.json from Collate
* Add test to check PIICategoryTags agree with the ones used by OM server
* Add LabelExtractor
* Fix style
* Add ignore superflous-parens for pylint
* Ass comment as per PR review
* Fix not-updated PII-IT
* Remove duplicated IT test for PII
---------
Co-authored-by: Pere Menal <pere.menal@getcollate.io>
Co-authored-by: Sriharsha Chintalapani <harshach@users.noreply.github.com>
* queryParams to the webhook request URL
* add activityThreadsRetentionPeriod in the DataRetentionApplication jsons
* clean up activity threads of type conversation
* Revert "clean up activity threads of type conversation"
This reverts commit e66ea8623be6aa1c5d07afdec04b4807eb21c7e7.
* Revert "add activityThreadsRetentionPeriod in the DataRetentionApplication jsons"
This reverts commit 4180be18a8d5e0d4fd4b3d4662df0532bb16dbed.
* deprecation: remove testCaseResults endpoint from testCaseResource
* fix: path in test e2e test
* fix: endpoint name to testCaseResults
* style: fix java linting
* Fix#21533 - Add a tool to openmetadata-ops.sh to delete orphaned relations
* Fix#21533 - Add a tool to openmetadata-ops.sh to delete orphaned relations
* Add exit 1 and make dry-run default
* Add exit 1 and make dry-run default
* Fix checkstyle
---------
Co-authored-by: Pere Miquel Brull <peremiquelbrull@gmail.com>
* Adding Data Insights Migrations to remove Stale Objects
* Adding Data Insights Migrations to remove Stale Objects
* Adding dettachment to ES ILM policy from Index and template
* Adding dettachment to ES ILM policy from Index and template
* Adding dettachment to ES ILM policy from Index and template
* Fix Checkstyle
* Moved migrations to 172
* Removed code that was left over on 171 migration
* Improve SearchClient error handling
* Add logic to handle WorkflowContext on Ingestion
* Revert base.py changes
* Removed comment
* Fix basedpyright complaints
* Make ContextManager automatically add its context to the PipelineStatus
* Small changes
* Only dump non-null keys
* Add Method to Filter Ingestion Pipeline based on Metadata
* Reduce the scope to filter only specifically on metadata->workflow->serviceName
* Fix#21430 : Tier tag not updating in search filters
* Fix#21430 : Tier tag not updating in search filters
* add tests
* test: add test for glossary term
* test: add test coverage for all entities
* fix tests
* fix tests
* fix: service entity tests
---------
Co-authored-by: Pranita <pfulsundar8@gmail.com>
Co-authored-by: Sriharsha Chintalapani <harshach@users.noreply.github.com>
* Bump ch.qos.logback:logback-core from 1.4.x to 1.5.13 in /openmetadata-service
* match logback-classic.version to logback-core.version
* upgrade dropwizard version to 4.0.14 and logback to 1.5.18
---------
Co-authored-by: Sriharsha Chintalapani <harshach@users.noreply.github.com>
* Issue-19251: Upgrade dropwizard to 4.x and Jetty to 11.x
* keep jdbi3.37.1 version for ConnectionAware functionality
* Code builds
* Merge with main and fix MCP
* Fix to make server run
* Tests fix
* JsonArray causing issue
* Fix WebSockets
* fix json2schema using jakarta instead of javax
* Fix patch tests
* Fix tests
* Register auditing subtypes in OpenmeteadataOperations
---------
Co-authored-by: mohitdeuex <mohit.y@deuexsolutions.com>
Co-authored-by: sonikashah <sonikashah94@gmail.com>
Co-authored-by: Mohit Yadav <105265192+mohityadav766@users.noreply.github.com>
* feat: prep for collate support
- Added support for delayed background jobs. This is to delete the support user after a while.
- added ScheduleType.OnlyManual for applications to support only manual triggers
- Added a four hour token expiration
- Allow a null trigger type in job data (not sure what it's for)
* added test for delayed job
* added type checking for enumCleanupArgs in navbar
* - added a support toten type
- added job handler for delete token
* fixed whitelist links
* patch OnlyManual apps
* Update openmetadata-spec/src/main/resources/json/schema/entity/applications/app.json
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
* added indexes for runAt
* use NO_JOB_SLEEP_SECONDS in background job test
* Fixed NavBar test
* removed backticls
* fix indexes
* change for support app
* fix tests
---------
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
Co-authored-by: Karan Hotchandani <33024356+karanh37@users.noreply.github.com>
Co-authored-by: karanh37 <karanh37@gmail.com>
Co-authored-by: Pere Miquel Brull <peremiquelbrull@gmail.com>
* Add missing workflow config status migrations
* Moved to Java based migrations to redeploy pipeline
* Moved migrations to Java. Updated Listener based on config
* Improved update on the migrations
