* queryParams to the webhook request URL
* add activityThreadsRetentionPeriod in the DataRetentionApplication jsons
* clean up activity threads of type conversation
* Revert "clean up activity threads of type conversation"
This reverts commit e66ea8623be6aa1c5d07afdec04b4807eb21c7e7.
* Revert "add activityThreadsRetentionPeriod in the DataRetentionApplication jsons"
This reverts commit 4180be18a8d5e0d4fd4b3d4662df0532bb16dbed.
* Update the file upload option input for service config
* Separate out the field rendering for 'uiFieldType' as fileOrInput and file.
---------
Co-authored-by: Sriharsha Chintalapani <harshach@users.noreply.github.com>
* Add logic to handle WorkflowContext on Ingestion
* Revert base.py changes
* Removed comment
* Fix basedpyright complaints
* Make ContextManager automatically add its context to the PipelineStatus
* Small changes
* Issue-19251: Upgrade dropwizard to 4.x and Jetty to 11.x
* keep jdbi3.37.1 version for ConnectionAware functionality
* Code builds
* Merge with main and fix MCP
* Fix to make server run
* Tests fix
* JsonArray causing issue
* Fix WebSockets
* fix json2schema using jakarta instead of javax
* Fix patch tests
* Fix tests
* Register auditing subtypes in OpenmeteadataOperations
---------
Co-authored-by: mohitdeuex <mohit.y@deuexsolutions.com>
Co-authored-by: sonikashah <sonikashah94@gmail.com>
Co-authored-by: Mohit Yadav <105265192+mohityadav766@users.noreply.github.com>
* feat: prep for collate support
- Added support for delayed background jobs. This is to delete the support user after a while.
- added ScheduleType.OnlyManual for applications to support only manual triggers
- Added a four hour token expiration
- Allow a null trigger type in job data (not sure what it's for)
* added test for delayed job
* added type checking for enumCleanupArgs in navbar
* - added a support toten type
- added job handler for delete token
* fixed whitelist links
* patch OnlyManual apps
* Update openmetadata-spec/src/main/resources/json/schema/entity/applications/app.json
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
* added indexes for runAt
* use NO_JOB_SLEEP_SECONDS in background job test
* Fixed NavBar test
* removed backticls
* fix indexes
* change for support app
* fix tests
---------
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
Co-authored-by: Karan Hotchandani <33024356+karanh37@users.noreply.github.com>
Co-authored-by: karanh37 <karanh37@gmail.com>
Co-authored-by: Pere Miquel Brull <peremiquelbrull@gmail.com>
* wip
* feat: trigger external apps with override config
- Added in openmetadata-airflow-apis functionality to trigger DAG with feature.
- Modified openmetadata-airflow-apis application runner to accept override config from params.
- Added overloaded runPipeline with `Map<String,Object> config` to allow triggering apps with configuration. We might want to expand this to all ingestion pipelines. For now its just for apps.
- Implemented an example external app that can be used to test functionality of external apps. The app can be enabled by setting the `ENABLE_APP_HelloPipelines=true` environment variable.
* fix class doc for application
* fixed README for airflow apis
* fixes
* set HelloPipelines to disabeld by default
* fixed basedpywright errros
* fixed app schema
* reduced airflow client runPipeline to an overload with null config
removed duplicate call to runPipeline in AppResource
* Update openmetadata-docs/content/v1.7.x-SNAPSHOT/developers/applications/index.md
Co-authored-by: Matias Puerta <matias@getcollate.io>
* deleted documentation file
---------
Co-authored-by: Matias Puerta <matias@getcollate.io>
* Adds followers to services and database schema
* Add delete and followers fields
* Add missing fields
* Fix failing test for get entity with different fields
* Fix ingestion test case failure
* Add IAM config for natural language search
* Add IAM config for natural language search
* Add IAM config for natural language search
---------
Co-authored-by: Mohit Yadav <105265192+mohityadav766@users.noreply.github.com>
* Fix : case-insensitive issue on aggregation and simplify aggregation API response format
* add lowercase normaliser for service.name.keyword
* add lowercase normaliser for database.name.keyword, databaseSchema.name.keyword, columns.name.keyword
* fix lowercase normaliser for database.name, databaseSchema.name
* create new aggregateRequest.json and update aggregate function
* remove sort field in subAgg and trackScores(false)
* cleanup function
* rename aggregation Field
* fix the search cases
* fix locales
* fix search
* add test case
* hide lineage search for higher level layers
* fix tests
---------
Co-authored-by: Karan Hotchandani <33024356+karanh37@users.noreply.github.com>
Co-authored-by: karanh37 <karanh37@gmail.com>
Co-authored-by: Pere Miquel Brull <peremiquelbrull@gmail.com>
* Renamed DayOneApp to SmartStart
* Fix Checkstyle
* Change the day one app references in the UI
* Change Smart Start to Auto Pilot
* Adding autoPilotAppConfig.ts generated file
* fix
* Update the generated types
* Change the Auto Pilot to AutoPilot
---------
Co-authored-by: Aniket Katkar <aniketkatkar97@gmail.com>
* chore: explicit types in appRunRecord.json
This does not change the actual schema of AppRunRecord so no database migrations are required. It improves the ergonomics of building a an app status.
* fixed AppLogsViewer.component.tsx
* modified AppUtils to use new schema
* added wide catcher
* fix: made databricks httpPath required and added a migration file for the same
* fix: added sql migration in postDataMigration file and fix databricks tests
* fix: added httpPath in test_source_connection.py and test_source_parsing.py files
* fix: added httpPath in test_databricks_lineage.py
* fix: table name in postgres migration
