This commit introduces a robust, transactional, and extensible framework for custom governance workflows in OpenMetadata.
Key features and improvements include:
Transactional Workflow Management: A new WorkflowTransactionManager ensures atomic operations for creating, updating, and deleting workflow definitions, maintaining consistency between the OpenMetadata database and the Flowable engine.
Safe ID Encoding: Implemented a WorkflowIdEncoder to generate safe, Base64-encoded, and collision-resistant IDs for Flowable processes, preventing errors from ID truncation.
Rollback and Deprecation Tasks:
Added RollbackEntityTask to revert entities to their last approved state.
Introduced DeprecateStaleEntityTask for automated lifecycle management of stale assets.
Enhanced Workflow Engine:
Improved WorkflowHandler to validate workflow definitions before deployment.
Added new custom functions to the rule engine for checking entity update timestamps and calculating field completeness scores.
CI/CD and Build Improvements:
Updated the CI Dockerfile with a multi-stage build and refined dependency installation.
Modified POM files to include necessary dependencies for new features.
* Initial plan
* Implement system default persona preferences support
- Allow users to set preferences for system default persona even without direct assignment
- Update validation logic in UserRepository.updatePersonaPreferences()
- Add test to verify system default persona preferences functionality
- Maintain validation for non-assigned, non-system-default personas
Co-authored-by: harshach <38649+harshach@users.noreply.github.com>
* Add manual verification tests for system default persona fix
Co-authored-by: harshach <38649+harshach@users.noreply.github.com>
* Clean up temporary files
Co-authored-by: harshach <38649+harshach@users.noreply.github.com>
* Fix tests
---------
Co-authored-by: copilot-swe-agent[bot] <198982749+Copilot@users.noreply.github.com>
Co-authored-by: harshach <38649+harshach@users.noreply.github.com>
Co-authored-by: Sriharsha Chintalapani <harshach@users.noreply.github.com>
Co-authored-by: Sriharsha Chintalapani <harsha@getcollate.io>
* Adding deployIngestionPipeline method to the IngestionPipelineRepository
* Add Missing entityspecificUpdate
* Fix updating relationships
* Made updateProcessingEngine protected
* Update updateFrom and updateTo relationship to be able to just delete a relationship if we update it to null
* added force test connection
* fixed test connection appearns on input field click
* fixed test connection
* removed blocker when ingestion is off
* made test connection consistent
* fixed test cases
* removed condition on test
* removed delete initiated condition
* fixed custom service condition
* fix the lineage layers not visible upfront
* fix the platform lineage height, added tooltip on radio buttons and remove the new node styling for the root node
* commented out the lineage view as we will re-design it
* remove unwanted code and fix the playwright removing the table test portion
* fix the sonar test
* Upgrade playwright version to 1.54.2 (latest) to support indexedDb storageState (#22879)
* bump playwright version to latest
* update playwright version in workflow files
* update playwright installation step in workflow files to ensure consistent working directory
---------
Co-authored-by: “maulikkotak98” <“maulik.k@deuexsolutions.com”>
* update playwright version to 1.51.1
* fix tests for lineage
* minor refactor and cleanup
* fix lineage tests
---------
Co-authored-by: Maulik Kotak <72746599+maulikkotak98@users.noreply.github.com>
Co-authored-by: “maulikkotak98” <“maulik.k@deuexsolutions.com”>
Co-authored-by: Aniket Katkar <aniketkatkar97@gmail.com>
