* Setup schema and core lineage traversal service for retrieving downstream entities
* Update getTargetsForAlert signature to use SubscriptionDestination
* Modify alert target finder method to support lineage entities analysis
* Rename utility class and method to explore downstream entities of the lineage graph
* Apply style
* Prevent entering on recursion when maxDepth is lower than 0
* Update generated TypeScript types
---------
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
* jsonschema
* MINOR - Add Security, SLA and Terms of Use to Data Contract
* Update generated TypeScript types
---------
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
* Initial Implementation of Adding Status and Reviewers to assets for workflows
* Update generated TypeScript types
* Copilot Review Comments Addressed
* Removed DataProduct Reviewer Inheritance as it is irrelevant
* Commit: Classification has status and reviewers, DataContract uses the same status enums, changed the logic to be APPROVED instead of Active, DataContract can have null status as seen in tests, Changed Workflow to use workflowStatus instead of status as it is contradicting with the approval status, Fixed Tests
* Default for reviewers is null
* Default for reviewers is createSchema
* Addressed CoPilots comments
* Update generated TypeScript types
* Workflow status to workflowStatus in db and migrations
* Revert "Workflow status to workflowStatus in db and migrations"
This reverts commit 676e8789358654bc6f980f855c372f33c22fc40b.
* Changed status to entityStatus in the schema files
* Java Implementation of Default Status, Search Client improvements and Test fixes and new tests
* Adding entityStatus and reviewers in the searchIndex mappings and common attributes
* Data Migration scripts to change the glossaryTerm and dataContract structure
* Update generated TypeScript types
* Fixed zh/spreadsheet index json error
* Fix Postgre migration script
* Changed the entityStatus.json to status.json
Removed the duplicates of entityStatus in the indexMapping
Modified the sample data to take in EntityStatus.Approved instead of ContractStatus.Active
* Update generated TypeScript types
* dummy commit
* Fix UI Build Issues with the New EntityStatus
Fix py tests
* Migrations for all the entities that need entityStatus
* Update generated TypeScript types
* Removed Post Migration scripts
* Fix UI and py for entityStatus
* Update generated TypeScript types
* Fix: DataContractResourceTest
* Fix UI and py for importing entityStatus
* UI to show and fetch Reviewers
* cleanup
* Removed Overridden SetDefaultStatus in GlossaryTermRepository
* Removed unnecessary validation
* Added entityStatus in search_entity_index_mapping.json
* Fixed DataContractResourceTest
* mvn spotless apply and fix migration scripts
* fix tests
* fix type error
* fix advanced search tests
* Status comparison using enums and supportsStatus to supportsEntityStatus
* mvn spotless apply
* fix merge conflict
* update entity status
* fix tests
---------
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Karan Hotchandani <33024356+karanh37@users.noreply.github.com>
Co-authored-by: karanh37 <karanh37@gmail.com>
* feat(ui): support add edit for semantic rules
* support QueryBuilder with tree change
* Update generated TypeScript types
* update querybuilder widget and add tests
* fix conflicts for tree rendering
* add validation for sematic rules
* fix unit tests and address comment
* fix data contract tests
* add unit tests for contract components
* fix styling and add tests
* address comments
---------
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
* Separating terms and tags in action config
* Update generated TypeScript types
* add: migration files for separate tags and terms
* chore: java formatting
* yaml formatting
* Chore: updated the release number
* updated to v194 as per release cycle
* updated to v195 as per release cycle
---------
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: --global <--global>
* Upgrade Mcp to 0.11.2
Use stateless Mcp Servlet
* Add Test for Load Testing and Improve Search Response
* Fixed Glossary And Patch Test
* Add user tests
* Fix failing load test
* fix change event handling for alerts
* contract is deleted when asset is deleted
* add support for custom properties
* Update generated TypeScript types
* handle suite index deletion
* validate owner is not coming back if not requested
---------
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
* Fix live update bugs
* support automator status
* fix query search index
* Update the logic to display the AutoPilot status and add playwright test
* Fix tests
---------
Co-authored-by: ulixius9 <mayursingal9@gmail.com>
* Add lineage to Exasol connector
* Update test_connection to return TestConnectionResult
* Add exasol tests & dependencies to tests in setup.py
* Opensearch is required for testing, so add it there
* Modify metadata
* Update documentation for lineage
* Apply formatting changes to code
* Apply make py_format
* Draft Implementation of Auto approve Glossary Terms - JsonLogicFilter
* Update generated TypeScript types
* Fixed Issues: PassFilter Inversion when jsonLogic is true, Unescaping JsonFilter
* Corrected the Test Expectations and fixed the test
* Fixed the Test for auto approval
* Fixed Java Checkstyle
* Added Entity to the jsonLogic Map for rule application so that other operations on entity is also used in jsonLogic
* Implementation of Code Review Changes
1. Use the Singleton Rule Engine and add Operations
2. Use Migrations and remove the backward Compatibility
* Update generated TypeScript types
* Removed Flowable variable updatedBy
* Update CheckEntityAttributesImpl to use Singleton rule instance
* Final Design: Improved Json Logic Triggers : isChanged, isReviewer, isOwner
* Fixed Issue: Extracting var from isChanged rule
* Fixed Issue: Fixed comment and trigger properties for entityBasedTrigger
* Hybrid approach: Exclude Fields + JsonLogic
* Update generated TypeScript types
* Added a lot of test cases!
* Auto Approve Glossary Terms during creation to avoid forever DRAFT state
* Added nodes for auto approve for reviewers
* Revert starting terms in DRAFT
* Adding Migrations to take the fresh data from the seed config, since our default workflow definitions have been changed.
* Handled Migrations properly for glossary term auto approve nodes
* Fix Merge Conflicts - Updated MigrationUtil, Fixed GlossaryStates test with newly added nodes
* Add Trigger filter to have empty string
* Fix Java checkstyle
* Updated the JsonLogic apply to incorporate RuleEngine changes
* Update the default rule for checkglossaryterm has reviewers node in governance workflow
* add migration logic
* Fix Flaky Optimistic Lock exception in the test case
* add tests
* Fix: 1. Propagate updatedBy from the trigger and make the updatedBy to be a reviewer in case of auto approval by reviewer.
2. Multiple Workflow Instance Conflicts resolution
* Remove early no conflict return
* revert search provider changes
---------
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Karan Hotchandani <33024356+karanh37@users.noreply.github.com>
Co-authored-by: karanh37 <karanh37@gmail.com>
Co-authored-by: sonika-shah <58761340+sonika-shah@users.noreply.github.com>
* Fix#21361: Live charts for service insights
* websocket implementation
* Minor refactoring
* update the UI for PlatformInsights and TotalDataAssets widgets.
* Remove unused state and variable
* Implement the live updates logic for Platform insight charts
* Add healthy data assets chart to platform insights
* Add agents widget
* add DI migrations to 190
* Add Agents status widget
* pass collateAgentsList to service insights tab
* Add the styling for CollateAI agents status cards
* add service name in response and stop stream api
* Fix the style variable names
* fix fields bug
* add remaining charts
* add total assets live chart
* pipeline_status_live
* Implement the stop socket connection for service insights live update
* Fix the chart names for live update
* fix services
* fix description
* handle ingestion pipeline status
* Add icons for agents and statuses
* alerts api eslint fix
* Fix the logic to update the agents statuses from websocket response
* Add missing localization keys
* Remove the autopilot status banner
* Fix total data assets widget live updates
* Remove commented code
* Add collate app status
* Update generated TypeScript types
* uncomment the websocketProvider code
* Make changes for live updates for collate AI agents
* Remove unnecessary changes and move util function to util file
* Fix the playwright and add check to prevent the live updates of one service showing for others
---------
Co-authored-by: Aniket Katkar <aniketkatkar97@gmail.com>
Co-authored-by: Pere Miquel Brull <peremiquelbrull@gmail.com>
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
* feat: Add Chart Details Page and update Dashboard Chart Table
This commit introduces a new dedicated page for displaying chart details, mirroring the functionality of the existing dashboard details page.
Key changes include:
- Creation of components, tests, and mocks.
- Creation of component and its interface.
- Creation of and .
- Renamed to to support JSX syntax.
- Updated application routing to include FQN in chart detail URLs.
- Modified to link chart names to the new chart details page.
* fix tests
* add chart class playwright
* Refactor chart details and constants for improved type support
Updated ChartDetails component and related interfaces to improve type safety and support for Chart as a data asset. Removed custom properties tab and widget from chart details. Added chart entity to data asset types and constants, and updated color schemes for chart visualizations. Adjusted permission handling and tab generation logic for chart details.
* add charts custom properties
* chart page bug fixes (#22490)
* Update generated TypeScript types
* fix tests
* mvn formatting
* add visit page link
* domain migration
* add announcements
* fix test
* Update ChartDetailsUtils.tsx
* fix style issue
* update routes
---------
Co-authored-by: Dhruv Parmar <83108871+dhruvjsx@users.noreply.github.com>
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Shailesh Parmar <shailesh.parmar.webdev@gmail.com>
* MINOR - Fix updates & add rule provider
* increrase the rule modal width and remove the rule column from table component in settings
* disabled edit and delete if system provider and change the rule logic
* format
* fix css of contract detail page and form component
* fix tests
* add the ability to ignore entities
---------
Co-authored-by: Ashish Gupta <ashish@getcollate.io>
Co-authored-by: Sriharsha Chintalapani <harshach@users.noreply.github.com>
* feat: security service initial code
* support secrity type for service from ui
* refactor: added missing java files for security service and require json files
* refactor: added doc file, oneOf java changes for ranger
* Merge branch 'main' of https://github.com/open-metadata/OpenMetadata into issue-20145
* update the security services schema to have domains instead of domain
* fix: added security service metadata pipeline
* Make changes for security service UI
* Update missing translation
* update type
* Fix the java checkstyle
* fix: added ingestionRunner in security service json
* Hide security service for OSS
* fix: reverse metadata documentation
* refactor: added securityConnection in test connection
* fix: documentation and ts file changes
* fix: deleted __init__ file and added SSISConnection again in the workflowclassconverter.java
* fix: convert domain to domains
* fix: added new file for basicAuth for ranger and change in rangerConnectionClassConverter.java file
* fix: java checkstyle
* fix: mysql security service sql
* fix: security service index mapping
* fix: moved migrations in new version and fix classConverterFactory
---------
Co-authored-by: Chirag Madlani <12962843+chirag-madlani@users.noreply.github.com>
Co-authored-by: Aniket Katkar <aniketkatkar97@gmail.com>
* Data Asset Rules configuration in settings
* Enable, delete and API loading states
* Convert card listing to table listing
* Icon update for preference page menu item
* Table loading fix on delete and edit
---------
Co-authored-by: Satish <satish@Satishs-MacBook-Pro.local>
Co-authored-by: Karan Hotchandani <33024356+karanh37@users.noreply.github.com>
* Initial Implementation of ER Diagram Upstream and downstream implementation
* Fix: Extra endpoint of entityRelationship removed
* Fix: Add upstreamEntityRelationship property in table index mappings for ES
* Fix: Removed isConnectedVia since it is not required for ER Diagram
* Improved some code, not final
* Fixed: Working with test cases
* Moved to TableResource from Database resource, need to fix tests
* Improved code and fixed test cases
* Fixing Painless Scipts along with reindexing Null Pointer Exceptions
* Reverted changes for Database Schema entity relationship
* Revert "Reverted changes for Database Schema entity relationship"
This reverts commit 544dd342fec924062d769472e59b29f0aa0eaf30.
* Minor: Reverted changes for Database Schema entity relationship - Fixed Build
* Refactor code: Fix Unnecessary functions, corrected imports
* Refactor code: Improve Test cases , fixed addNode to fqn hash inconsistency, Added Extra test cases for multihop and multi parent use case
* Refactor code: Make tests run in the same thread to not collide with other entity relationship tests
* Refactor code: Create Foreign Keys during the create table itself to avoid orphans
* Refactor code: Improve Test Cases to find the node and upstream details for matching as well
* Refactor code: Corrected Typo
* Update generated TypeScript types
* Database Schema ER Diagram Initial Implementation
* Refactor: Safe Delete function
* Update generated TypeScript types
* Refactored: GraphBuilders to closely Follow Lineage, Fixed Test Cases, refactored constants and generic pagination
* Test cases for Lineage and Improved Test cases for EntityRelationship for Table Level
* Test cases for Platform Lineage and DatabaseSchema ER Diagram
* Initial Improved Implementation of Database Schema ER with pagination
* mvn spotless apply
* Fixed the Test for auto approval
* Update generated TypeScript types
---------
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Ashish Gupta <ashish@getcollate.io>
