* fix: made databricks httpPath required and added a migration file for the same
* fix: added sql migration in postDataMigration file and fix databricks tests
* fix: added httpPath in test_source_connection.py and test_source_parsing.py files
* fix: added httpPath in test_databricks_lineage.py
* fix: table name in postgres migration
* chore: added index for apps_extension_time_series.timestamp
* - added timestamp index for workflow_instance_time_series
- added timestamp index for workflow_instance_state_time_series
* Refactor: Introduce openMetadataBaseUrlConfiguration to set up the server endpoint and remove OpenMetadataUrl from smtpSettings.json
* migrations.
* refactor(cli): add setOpenMetadataUrl command to store OpenMetadata URL
* refactor(cli): add configureEmailSettings command to manage SMTP/Email configuration
* load initialData when config is not present in the db
* add om url settings page
* update locales
* add e2e
* load omBaseUrl with default host and port: localhost:8585 when not present
---------
Co-authored-by: Karan Hotchandani <33024356+karanh37@users.noreply.github.com>
Co-authored-by: karanh37 <karanh37@gmail.com>
* feat(apps): support event subscriptions
- added support for apps with event subscriptions.
- added support for custom consumers on event subscriptions.
- use native application methods instead of reflection in ApplicationHandler
* removed runMethodFromApplication reflection and use concrete methods from AbstractNativeApplication
* format
* fix(governance-workflows): defined interface in workflow schema
- defined types for workflow nodes
- fixed updateEdge method in WorkflowDefinitionRepository
* ref(governance-workflows): use explicit types in schema
use explicit interface type in json schemas and use annotations to infer the concrete classes when deserializing
* - implemented CustomSignal trigger
- use JsonTypeInfo and JsonSubTypes to infer types in jsonschema for nodes and triggers
- Implemented JsonLogicFilter task
- implemented placeholder noop task
* - simplified trigger type names
- removed governance workflow root "type"
- added "deployed" field to governance workflow
- applied changes to existing gov-workflows
- migrations
* fixed migrations
* backend
* format & tests
* rename backend
* migrations and ingestion
* format & tests
* format & tests
* tests
* format & tests
* tests
* updated ui side of changes
* addressing comment
* fixed failing unit test
* fix test list
* added e2e test, and fixed existing test
---------
Co-authored-by: Shailesh Parmar <shailesh.parmar.webdev@gmail.com>
* fix: combined index on offset and eventTime in changeEvent table
* fix: correct syntax error in Postgres query.
* fix: correct syntax error in Postgres query.
* fix: correct syntax error in Postgres query.
* fix: Update configuration for activity feed.
* fix: Migrations
* remove the customProperty and testSuite feed beautification case from the feed
* fix: Remove custom properties from the source
* fix: add metric in the matchAnySource.
---------
Co-authored-by: Ashish Gupta <ashish@getcollate.io>
* Move the alert components to the components folder from pages folder
* auto generated localization changes and linting changes
* Fix the imports
* Add AlertConfigDetails component
* Add tabs in the alert details page
* auto generated localization changes
* Apply permissions for alert and add owner update functionality
* Change the alert update method from PUT to PATCH
* Add the recent events tab
* auto generated localization changes
* Improve the recent events tab for alert details
* Implement the logic to show alert events count on the alert details page
* auto generated localization and linting changes
* Add the pagination logic for the recent events list on the alert details page
* Fix the logic for previous click in NextPreviousWithOffset
* Localization change for other languages
* Hide pagination when not required
* Add pagination and permissions to API; create eventsRecord API; fix timestamp issue
* fix: remove publisherName from test destination message.
* Fix the recent events tab error
* fix: Resolve PATCH API issue with destination ID creation.
* fix: Delete associated alert metrics upon alert deletion
* feat: Detailed HTTP Response for Destination Test
* Add the test external destination functionality
* localization changes for other languages
* fix: Set status for testing destination in EmailPublisher
* Add advanced configurations for webhook destinations
* Localization changes for other languages
* Fix the destination status not showing
Add the POST and PUT radio button in advanced configs
* Localization changes for other languages
* Update the API to fetch the alert event diagnostic counts
* Improve the AlertConfigDetails component to show the alert configs properly
* fix: Display displayName instead of fullyQualifiedName in templates
* Fix the test destination result not showing the first time
* Fix the test destination status not showing for already existing destinations
* Fix the unit tests
* Fix playwright tests
* refactor: Separate sendMessage and sendTestMessage methods; add statusContext
* fix: Use name or fqn as fallback if displayName is null or empty
* fix: upsert successfulChangeEvent
* eliminate the GovernanceWorkflowChangeEvent option from external destination
* Add code comments
* Fix the unit test
---------
Co-authored-by: Siddhant <86899184+Siddhanttimeline@users.noreply.github.com>
Co-authored-by: Siddhanttimeline <siddhanttimeline9@gmail.com>
* Initial implementation for Governance Workflows
* Remove file that shouldn't be there
* Initial implementation for the governance workflows
* Refactor JSONSchema for Governance Workflows
* Refactored WorkflowInstanceStatus to keep the stage properly
* Fix Migration for MySQL for the WorkflowInstanceStates change
* Update WorkflowInstanceState to track all the states propertly
* Initial code tro migrate Request type of Tasks
* copy governance schemas into json directory
* update schema names
* Extract WorkflowInstance into its own resource
* Update WorkflowInstance to have the workflow starting variables
* Changed relatedEntity to be an EntityLink
* First iteration on checkEntityAttributes JSONLogic
* Refactored Workflow into TriggerWorkfow and MainWorkflow
* Fixed WorkflowInstance and WorkflowInstanceState
* Fixed WorkflowInstance and WorkflowInstanceState when process is terminated
* Fix UserTask
* json logic changes to workflow
* Fix Patch request. Add exclude filter to EventBasedEntityTrigger
* update query builder
* Fix Migrations
* Fix Migrations
* modify query builder widget
* fix search props
* update widget and use default fields
* Update edges to always have a true/false condition
* made changes to provider for fields
* push progress
* fix grouping of array field
* Remove duplicated migrations
* Fix migrations
* Fix migrations
* Fix Tests and commit some improvements suggestion
* fix unit tests
* Add Certification Workflow
* Fix Tests
* Fix Tests
* fix tests
* add delay in pagination tests
* fix minor config changes for json logic
* change the glossary page
* Remove Table Certification Workflow seed Data
* add json logic and elastic search parsers
* minor schedule interval changes for workflows
* minor fixes to the parsing logic
* certification ui
* fix tests
* fix tests
* add other search fields
* Add Certification to search index
* Update index mapping for certification
* add quick filter for certification
* update locales
* Fix index mapping
* Add missing index updates
* Fix checkstyle
* increase timeout
* skipping user test
* skipping team test
---------
Co-authored-by: karanh37 <karanh37@gmail.com>
Co-authored-by: Karan Hotchandani <33024356+karanh37@users.noreply.github.com>
Co-authored-by: Sriharsha Chintalapani <harshach@users.noreply.github.com>
Co-authored-by: sonikashah <sonikashah94@gmail.com>
Co-authored-by: sonika-shah <58761340+sonika-shah@users.noreply.github.com>
* fix getSuccessfullySentChangeEventsForAlert
* migrations.
* offset-based pagination
* add startingOffset in EventSubscriptionDiagnosticInfo
* fix missing paginationOffset
* Record successfully sent change events in a separate table, clean up associated successful and failed records on alert deletion.
* Remove oldest 30 records if record count reaches 100 for successful_sent_change_events.
* list unprocessed changeEvents based on alert subscription rules, ensuring only relevant unprocessed events are listed.
* refactor: enhance eventSubscriptionDiagnosticInfo
Added new fields to the eventSubscriptionDiagnosticInfo schema to support detailed diagnostics:
- `relevantUnprocessedEventsCount`: Count of relevant unprocessed events based on alert filtering rules.
- `relevantUnprocessedEventsList`: List of relevant unprocessed events based on alert filtering rules.
- `totalUnprocessedEventsCount`: Count of all unprocessed events.
- `totalUnprocessedEventsList`: List of all unprocessed events.
* Refactor: delete 30 oldest records per alert when the count reaches 100 records
* fix: table creation issue in PostgreSQL
* fix tests.
* scheduleCleanupJob
* remove in-line deletion of records.
* fix postgres table structure issue.
* create EventSubscriptionDiagnosticInfo
* API for failedEvents
* migrations
* add index on source
* list all failedEvents optionally filtered by source
* refactor
* refactor
* getSuccessfullySentChangeEventsForAlert API
* increase defaultValue of limit to 100
* resolve conflicts
* listEvents API with 'failed', 'successful,' and 'unprocessed' query parameters
* fix description
* eventSource as enums
* refactor name.
---------
Co-authored-by: Sriharsha Chintalapani <harshach@users.noreply.github.com>
* MINOR - Renaming MetaPilot to CollateAI
* MINOR - Renaming MetaPilot to CollateAI
* MINOR - Renaming MetaPilot to CollateAI
* MINOR - Renaming MetaPilot to CollateAI
* fix
* moving limits migrations for 1.5.9
* fix(ui): pagination issue with search in services list page
* Add Apps Data store
* Revert Services Changes
---------
Co-authored-by: Chirag Madlani <12962843+chirag-madlani@users.noreply.github.com>
