* feat: prep for collate support
- Added support for delayed background jobs. This is to delete the support user after a while.
- added ScheduleType.OnlyManual for applications to support only manual triggers
- Added a four hour token expiration
- Allow a null trigger type in job data (not sure what it's for)
* added test for delayed job
* added type checking for enumCleanupArgs in navbar
* - added a support toten type
- added job handler for delete token
* fixed whitelist links
* patch OnlyManual apps
* Update openmetadata-spec/src/main/resources/json/schema/entity/applications/app.json
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
* added indexes for runAt
* use NO_JOB_SLEEP_SECONDS in background job test
* Fixed NavBar test
* removed backticls
* fix indexes
* change for support app
* fix tests
---------
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
Co-authored-by: Karan Hotchandani <33024356+karanh37@users.noreply.github.com>
Co-authored-by: karanh37 <karanh37@gmail.com>
Co-authored-by: Pere Miquel Brull <peremiquelbrull@gmail.com>
* Add missing workflow config status migrations
* Moved to Java based migrations to redeploy pipeline
* Moved migrations to Java. Updated Listener based on config
* Improved update on the migrations
This fixes an issue we saw in AUTs and sandbox-beta:
Caused by: java.lang.reflect.InaccessibleObjectException: Unable to make field private final long java.time.Instant.seconds accessible: module java.base does not "opens java.time" to unnamed module @44075f31
The RCA of this issue is an overriding we are doing on some internal argo lib classes in io.argoproj.workflow.JSON.
This was previously placed in collate-service. In the recent move to collate-spec when preparing the Hybrid Pipeline Service Client, we missed moving this. Then, the classpath was first loading the JSON class from the argo lib, rather than our fixed class inside collate-spec.
This is tricky since running the server from intellij works properly. However, the issue happens when running from openmetadata-server-start.sh, which is the dep used within Docker too.
* fix: made databricks httpPath required and added a migration file for the same
* fix: added sql migration in postDataMigration file and fix databricks tests
* fix: added httpPath in test_source_connection.py and test_source_parsing.py files
* fix: added httpPath in test_databricks_lineage.py
* fix: table name in postgres migration
* chore: added index for apps_extension_time_series.timestamp
* - added timestamp index for workflow_instance_time_series
- added timestamp index for workflow_instance_state_time_series
* Refactor: Introduce openMetadataBaseUrlConfiguration to set up the server endpoint and remove OpenMetadataUrl from smtpSettings.json
* migrations.
* refactor(cli): add setOpenMetadataUrl command to store OpenMetadata URL
* refactor(cli): add configureEmailSettings command to manage SMTP/Email configuration
* load initialData when config is not present in the db
* add om url settings page
* update locales
* add e2e
* load omBaseUrl with default host and port: localhost:8585 when not present
---------
Co-authored-by: Karan Hotchandani <33024356+karanh37@users.noreply.github.com>
Co-authored-by: karanh37 <karanh37@gmail.com>
* feat(apps): support event subscriptions
- added support for apps with event subscriptions.
- added support for custom consumers on event subscriptions.
- use native application methods instead of reflection in ApplicationHandler
* removed runMethodFromApplication reflection and use concrete methods from AbstractNativeApplication
* format
* fix(governance-workflows): defined interface in workflow schema
- defined types for workflow nodes
- fixed updateEdge method in WorkflowDefinitionRepository
* ref(governance-workflows): use explicit types in schema
use explicit interface type in json schemas and use annotations to infer the concrete classes when deserializing
* - implemented CustomSignal trigger
- use JsonTypeInfo and JsonSubTypes to infer types in jsonschema for nodes and triggers
- Implemented JsonLogicFilter task
- implemented placeholder noop task
* - simplified trigger type names
- removed governance workflow root "type"
- added "deployed" field to governance workflow
- applied changes to existing gov-workflows
- migrations
* fixed migrations
* backend
* format & tests
* rename backend
* migrations and ingestion
* format & tests
* format & tests
* tests
* format & tests
* tests
* updated ui side of changes
* addressing comment
* fixed failing unit test
* fix test list
* added e2e test, and fixed existing test
---------
Co-authored-by: Shailesh Parmar <shailesh.parmar.webdev@gmail.com>
* fix: combined index on offset and eventTime in changeEvent table
* fix: correct syntax error in Postgres query.
* fix: correct syntax error in Postgres query.
* fix: correct syntax error in Postgres query.
* fix: Update configuration for activity feed.
* fix: Migrations
* remove the customProperty and testSuite feed beautification case from the feed
* fix: Remove custom properties from the source
* fix: add metric in the matchAnySource.
---------
Co-authored-by: Ashish Gupta <ashish@getcollate.io>
* Move the alert components to the components folder from pages folder
* auto generated localization changes and linting changes
* Fix the imports
* Add AlertConfigDetails component
* Add tabs in the alert details page
* auto generated localization changes
* Apply permissions for alert and add owner update functionality
* Change the alert update method from PUT to PATCH
* Add the recent events tab
* auto generated localization changes
* Improve the recent events tab for alert details
* Implement the logic to show alert events count on the alert details page
* auto generated localization and linting changes
* Add the pagination logic for the recent events list on the alert details page
* Fix the logic for previous click in NextPreviousWithOffset
* Localization change for other languages
* Hide pagination when not required
* Add pagination and permissions to API; create eventsRecord API; fix timestamp issue
* fix: remove publisherName from test destination message.
* Fix the recent events tab error
* fix: Resolve PATCH API issue with destination ID creation.
* fix: Delete associated alert metrics upon alert deletion
* feat: Detailed HTTP Response for Destination Test
* Add the test external destination functionality
* localization changes for other languages
* fix: Set status for testing destination in EmailPublisher
* Add advanced configurations for webhook destinations
* Localization changes for other languages
* Fix the destination status not showing
Add the POST and PUT radio button in advanced configs
* Localization changes for other languages
* Update the API to fetch the alert event diagnostic counts
* Improve the AlertConfigDetails component to show the alert configs properly
* fix: Display displayName instead of fullyQualifiedName in templates
* Fix the test destination result not showing the first time
* Fix the test destination status not showing for already existing destinations
* Fix the unit tests
* Fix playwright tests
* refactor: Separate sendMessage and sendTestMessage methods; add statusContext
* fix: Use name or fqn as fallback if displayName is null or empty
* fix: upsert successfulChangeEvent
* eliminate the GovernanceWorkflowChangeEvent option from external destination
* Add code comments
* Fix the unit test
---------
Co-authored-by: Siddhant <86899184+Siddhanttimeline@users.noreply.github.com>
Co-authored-by: Siddhanttimeline <siddhanttimeline9@gmail.com>
* Initial implementation for Governance Workflows
* Remove file that shouldn't be there
* Initial implementation for the governance workflows
* Refactor JSONSchema for Governance Workflows
* Refactored WorkflowInstanceStatus to keep the stage properly
* Fix Migration for MySQL for the WorkflowInstanceStates change
* Update WorkflowInstanceState to track all the states propertly
* Initial code tro migrate Request type of Tasks
* copy governance schemas into json directory
* update schema names
* Extract WorkflowInstance into its own resource
* Update WorkflowInstance to have the workflow starting variables
* Changed relatedEntity to be an EntityLink
* First iteration on checkEntityAttributes JSONLogic
* Refactored Workflow into TriggerWorkfow and MainWorkflow
* Fixed WorkflowInstance and WorkflowInstanceState
* Fixed WorkflowInstance and WorkflowInstanceState when process is terminated
* Fix UserTask
* json logic changes to workflow
* Fix Patch request. Add exclude filter to EventBasedEntityTrigger
* update query builder
* Fix Migrations
* Fix Migrations
* modify query builder widget
* fix search props
* update widget and use default fields
* Update edges to always have a true/false condition
* made changes to provider for fields
* push progress
* fix grouping of array field
* Remove duplicated migrations
* Fix migrations
* Fix migrations
* Fix Tests and commit some improvements suggestion
* fix unit tests
* Add Certification Workflow
* Fix Tests
* Fix Tests
* fix tests
* add delay in pagination tests
* fix minor config changes for json logic
* change the glossary page
* Remove Table Certification Workflow seed Data
* add json logic and elastic search parsers
* minor schedule interval changes for workflows
* minor fixes to the parsing logic
* certification ui
* fix tests
* fix tests
* add other search fields
* Add Certification to search index
* Update index mapping for certification
* add quick filter for certification
* update locales
* Fix index mapping
* Add missing index updates
* Fix checkstyle
* increase timeout
* skipping user test
* skipping team test
---------
Co-authored-by: karanh37 <karanh37@gmail.com>
Co-authored-by: Karan Hotchandani <33024356+karanh37@users.noreply.github.com>
Co-authored-by: Sriharsha Chintalapani <harshach@users.noreply.github.com>
Co-authored-by: sonikashah <sonikashah94@gmail.com>
Co-authored-by: sonika-shah <58761340+sonika-shah@users.noreply.github.com>
