* Adding Data Insights Migrations to remove Stale Objects
* Adding Data Insights Migrations to remove Stale Objects
* Adding dettachment to ES ILM policy from Index and template
* Adding dettachment to ES ILM policy from Index and template
* Adding dettachment to ES ILM policy from Index and template
* Fix Checkstyle
* Moved migrations to 172
* Removed code that was left over on 171 migration
* Improve SearchClient error handling
(cherry picked from commit 472b95516d7ba2669323be50e0d6205a150e1686)
* Add logic to handle WorkflowContext on Ingestion
* Revert base.py changes
* Removed comment
* Fix basedpyright complaints
* Make ContextManager automatically add its context to the PipelineStatus
* Small changes
* Only dump non-null keys
* Add Method to Filter Ingestion Pipeline based on Metadata
* Reduce the scope to filter only specifically on metadata->workflow->serviceName
(cherry picked from commit 8540884ab1a132be2bacf7a921d11d5fa3ae6c16)
* Fix#21430 : Tier tag not updating in search filters
* Fix#21430 : Tier tag not updating in search filters
* add tests
* test: add test for glossary term
* test: add test coverage for all entities
* fix tests
* fix tests
* fix: service entity tests
---------
Co-authored-by: Pranita <pfulsundar8@gmail.com>
Co-authored-by: Sriharsha Chintalapani <harshach@users.noreply.github.com>
(cherry picked from commit cc1e8f7b5b5f91d87f1cdaca709b3742a41cd0e3)
* Add missing workflow config status migrations
* Moved to Java based migrations to redeploy pipeline
* Moved migrations to Java. Updated Listener based on config
* Improved update on the migrations
(cherry picked from commit b761efbfd33e1888dc59e0ef7fe636a9a98aa8c5)
* wip
* feat: trigger external apps with override config
- Added in openmetadata-airflow-apis functionality to trigger DAG with feature.
- Modified openmetadata-airflow-apis application runner to accept override config from params.
- Added overloaded runPipeline with `Map<String,Object> config` to allow triggering apps with configuration. We might want to expand this to all ingestion pipelines. For now its just for apps.
- Implemented an example external app that can be used to test functionality of external apps. The app can be enabled by setting the `ENABLE_APP_HelloPipelines=true` environment variable.
* fix class doc for application
* fixed README for airflow apis
* fixes
* set HelloPipelines to disabeld by default
* fixed basedpywright errros
* fixed app schema
* reduced airflow client runPipeline to an overload with null config
removed duplicate call to runPipeline in AppResource
* Update openmetadata-docs/content/v1.7.x-SNAPSHOT/developers/applications/index.md
Co-authored-by: Matias Puerta <matias@getcollate.io>
* deleted documentation file
---------
Co-authored-by: Matias Puerta <matias@getcollate.io>
(cherry picked from commit d91273a30d28de793941de74636963e29aa9e5d4)
* fix: test case alerts and un-indexable fields
* fix: test case alerts and un-indexable fields
(cherry picked from commit b1edb964699c1d365b9e1154f05591e4b26ebb21)
* Adds followers to services and database schema
* Add delete and followers fields
* Add missing fields
* Fix failing test for get entity with different fields
* Fix ingestion test case failure
* FIX - Try to install app before initializing the entity
* FIX - Try to install app before initializing the entity
(cherry picked from commit 2cbf032b1d3270b7ff2a4299179538e3688e387c)
* Remove ILM from Data Insights Data Streams
* Put DataInsights healthcheck wihtin SearchValidation
(cherry picked from commit 2ac773f4df28eff541dc3ac0ad98f070ee49b549)
