* Expose Workflow Stage Status and Bring OneDayApp to OSS
* Fix Migrations
* Change Bot and add comment
* Fix checkstyle
* Initial idea for triggering app manually
* Remove merge conflics rows
* Remove merge conflics rows
* Allow to Trigger DayOneApp Manually. Change its Trigger to NoOp
* add docs
* back to main
* Actually take into account the active status
* Fix the generated types
---------
Co-authored-by: Aniket Katkar <aniketkatkar97@gmail.com>
* MINOR - Add Test Case Automator
* MINOR - Add Test Case Automator
* MINOR - Add Test Case Automator
* MINOR - Add Test Case Automator
* simplify tc body for automator
* simplify tc body for automator
* simplify tc body for automator
* remove all
* dp
* Initial unification of create and run tasks
* Unify Create and Run Ingestion Pipeline Tasks
---------
Co-authored-by: Aniket Katkar <aniketkatkar97@gmail.com>
* - typo update
* - Update lineage model and api
(cherry picked from commit c5cce2b0c7c1be7ba654bfc2677da0d05215a895)
* - Adding patch
* - spotless fix
* Add Migration For createdAt , createdBy, updatedAt and updatedBy
* Moved classes from Elastic Client to Lineage Graph Builder
* Update to use correct depth
* remove toCondition
* Fix Downstream Lineage
* moved not so cool things here and there
* spotless-failures
* call with direction
* add upstream depth with + 1 for 0th node
* Fix Exports
* Fix Exports from and size
* parse lineage in ui
* Add per entity pagination
* Added per entity pagination
* Fix Async Export
* Fix Java Merges
* Fix merge conflict
* Fix missing upstream nodes
* lineage ui initial commit
* Fix Pagination for upstream
* Fix Values
* fix load more loading
* cleanup
* fix loading of nodes
* fix load more
* Fix Direction Values
* update expand collapse logic
* Fix Deletion Issue
* Fix Pipeline Lineage
* show pipeline as a node
* Use Fqn Hash to find entities is es for lineage
* update lineage
* Add Lineage for Pipeline to look for as edge and node
* Layer and size conditions for upstream and downstream
* Add include source fields in lineage request
* redesign controls component
* add lineage fixes
* fix tests
* Fix node
* Fix Some Failing Test on Lineage
* Java Spotless Fix and added missing relation check on migration
* Missing conflict changes
* fix conflicts
* added missing keys
* update tests
* Add Service Information in service indexes
* Add Domain Lineage
* Add domain lineages
* fix tests
* Fix Metric Entity Service Error
* Maintain Asset Count for entities adding service and domain lineage
* Update to Doc Id and add details to search
* Cleanup Service and Domain automatically
* fix types
* Update review comments
* fix icon sizes
* Update Services Index wit upstream lineage
* add service view
* Fix Service Name missingFix Service Name resolution in LineageRepository
Update the method to correctly retrieve the service name for the "fromEntity" by specifying the FIELD_SERVICE path. This resolves an issue where the service name was not properly populated.
* - Add docUniqueId to lineage data and update related queries
- Added lenient Object Mapper for search index to entities mapping
* - Fix LineageResourceTest failing due to changes on Lineage Storage
* - Update Lineage Details
---------
Co-authored-by: karanh37 <karanh37@gmail.com>
Co-authored-by: Karan Hotchandani <33024356+karanh37@users.noreply.github.com>
* Allowing to trigger an app with a payload
* added option to pass custom payload to triggered job
* feat(apps): add custom config to trigger
- added custom config for app triggers
* added handling for configuration validation on apps
* - removed `oneOf` from app configuration scheme
- generated ts files for apps
* added CONFIG_OVERRIDE_KEY
* format
* fixed app config key
* format
* format
* fixed python app runner to work with new schema
---------
Co-authored-by: sushi30 <imri.paran@gmail.com>
* Add the Platform Insights for the service details page
* Add new localization translations
* Fix the styling
* Add Data Quality widget in the service details page insights tab
* Remove the unused localization keys
* Fix the border radius
* Update the border color
* Add Total Data Assets widget
* localization changes
* Fix the Tier insights chart
* Add Tier and PII Distribution charts
* Localization changes
* Fix the calls for special fqn
* Limit the DataQualityWidget only to the DB services
* Add the MostUsedAssetsWidget
* Add missing loaders to the widgets
* Localization changes
* Update the API call for most used assets
* Add most expensive queries widget
* Localization changes
* Move the widgets logic to classBase for better customization
* Fix the font size
* add charts backend
* fix initialisation
* fix migration
* pii chart
* Add assets_with_tier DI system chart
* Fix the service insights charts
* localization changes
* spotless
* filter to be regex instead of literal compare
* Fix stylings for Most Used Assets widget
* Fix Unit tests
* Remove the New widgets
* Delete unused utils
* Fix the ServiceEntity tests
* Move SystemChartType to enum file
* Worked on comments
* Refactor ServiceInsightsTab and TotalDataAssetsWidget for improved code organization
* Refactor PlatformInsightsWidget and improve type safety
- Added PlatformInsightsWidgetProps interface for better type definition
- Updated PlatformInsightsWidget component to use the new interface
- Simplified component props typing
- Minor code cleanup in TotalDataAssetsWidget
- Updated Fqn utility method with a more precise regex replacement
* Refactor ServiceInsightsTab to use serviceDetails prop and remove Fqn utility method
- Updated ServiceInsightsTab to accept serviceDetails prop instead of using useFqn hook
- Removed Fqn.getNameWithoutQuotes method
- Updated PlatformInsightsWidget and TotalDataAssetsWidget to use serviceName prop
- Added ServiceInsightWidgetCommonProps interface for shared prop typing
- Simplified service name handling across components
* Refactor ServiceInsightsTabUtils to use local i18n import
- Updated import for internationalization to use local i18next utility
- Removed direct import of 't' from 'i18next'
- Imported i18n from local utility and destructured 't' method
* Improve type safety in TotalDataAssetsWidget component
- Added Readonly type to ServiceInsightWidgetCommonProps prop interface
- Enhanced type safety for component props
* add postgres migrations
---------
Co-authored-by: ulixius9 <mayursingal9@gmail.com>
* feat: add changeContext to changeDescription
* rev: unintended changes
* rev: unintended changes
* feat: implemented change summary field
- implemented ChangeSummarizer which handles change summaries based on tracked fields and list of fields changes.
- added a changeSummary field to table entity which captures change metadata like user, time and source
- added the changeSource as a field to updater. maybe breaks things in collate.
* use additional properties instead of existingJavaType otherwise types dont get created in java.
* added getUpdater(T original, T updated, Operation operation) to not break collate
* updated API docs
* - fixed null access of changeSummary
- added changeSummary to table index
* fix: PR comments
- added changeSummary as nested field in changeDescription
- removed unneeded migrations
- added changeSummary to table search index
* reverted table.json and TestUtils.java
* reverts
* support table details customization page
* update widget preview
* fix schema tab
* fix issue around save layout across tabs
* fix unit tests
* fix tab label with customized one
* misc fixes for persona edit
* update
* update topic with persona changes
* support dashboard data model
* support data assets with customization
* support pipeline with customize page
* fix console errors
* fix tests
* fix sonar cloud issues
* update code for data assets
* remove fqn prop as
* create generic tabs
* update
* support customization for domain page
* update
* fix errors
* fix tests
* update
* fix detail pages
* fix playwright tests
* fix unit tests
* fix unit tests
* update generic tab
* update
* fix tests
* fix tests
* fix data test id for tags and glossary terms
* fix version pages
* fix unit test
* update page enum with api collection
* update custom property to use generic provider
* fix api collection & endpoint
* fix apiCollection and apiEndpoint customization
* fix container test and fix sonar
* fix tests
* fix delete playwright
* support metric entity
* add metric as page type to customization
* fix container unit tests
* fix metric tests
* fix ml model customization
* fix test for mlmodel page
* fix Metric details tests
* fix tests
* fix test for database schema version page
* reset max failure for playwright
* improve icons
* address comments
* update translation
* update as per comments
* update localization
* update function signature
* update file names and fix imports
* address comments
* support tags and glossary to domain
* fix failing tests
* option to show hide task handlers
* Update Data Insights Configurations to enable more fine control management
* Update Data Insights Configurations to enable more fine control management
* Hide one configuration from DataInsights App
* Fix#19950: Add Tags/Glossary Term support for Domains & Data Products
* add tags and glossary terms to domain and data product
* fix snakeyaml dependency
* Fix search filtering for domain/dataProduct
* fix showing of domain on tags page
* fix merge conflicts
* addressed comments
---------
Co-authored-by: Sriharsha Chintalapani <harsha@getcollate.io>
* Add Day One Experience App JSONSchema
* Add 'uninstall' method to applications, that should run on deleteApp
* Fix JSONSchemas
* Treating the case where we are trying to suspend or resume a workflow already in that state
* Fix JsonSchema
* Fix#17723: Generate Incremental Change Events even when consolidation of events applied
* Fix#17723: Generate Incremental Change Events even when consolidation of events applied
* fix tests
* Fix tests
* clean policy tests
* update search methods to use incrementalChangeDescription part-1
* Fix the version page playwrights
* update search methods to use incrementalChangeDescription part-2
* introduce new field incrementalChangeDescription for search part-3
* fix mvn endpoint test
* fix followers and page search test
* fix following of assets
---------
Co-authored-by: Pere Miquel Brull <peremiquelbrull@gmail.com>
Co-authored-by: sonikashah <sonikashah94@gmail.com>
Co-authored-by: Aniket Katkar <aniketkatkar97@gmail.com>
Co-authored-by: sonika-shah <58761340+sonika-shah@users.noreply.github.com>
* feat(event-subscriptions): event consumer extension
- implemented DI for event consumers
- added custom config for event consumers
- initialize the event scheduler along with application
- added workflow custom type
* - removed the ConsumerService as it is specific for each consumer implementation
- added a "custom" alert type
* wip
* cleanup
* reverted pom.xml changes
* reverted pom.xml changes
* reverted pom.xml changes
* removed abstract layer AbstractOmAppJobListener
* fixed import AbstractOmAppJobListener -> OmAppJobListener
* fixed constructor
* - add event subscription if it doesnt exist (set operation)
- add deleteEventSubscription
* - use patch mode when updating app.eventSubscriptions
* added docs for DIContainer
* aligned py tests with new automation schema
* added AppRunRecord.properties
* format
* changes after merge
* generated missing ts
* use openmetadata config builder instead of the config
* add json logic fixes for reverse metadata
* ref: reverted changes ro workflows
they will be part of https://github.com/open-metadata/OpenMetadata/pull/19723
* ref: reverted changes to workflows
they will be part of https://github.com/open-metadata/OpenMetadata/pull/19723
* reverted ts changes
* reverted ts changes
* reverted ts changes
* fix: initialization sequence for event subscription scheduler
---------
Co-authored-by: karanh37 <karanh37@gmail.com>
Co-authored-by: Karan Hotchandani <33024356+karanh37@users.noreply.github.com>
* Add Run App Task
* Work on Run App Task
* Rollback task changes
* Fixing type convertion
* Fix Run External App wait
* Fix Run App Task
---------
Co-authored-by: Karan Hotchandani <33024356+karanh37@users.noreply.github.com>
* MINOR - Automator - Remove tags by label type
* MINOR - Automator - Remove tags by label type
* MINOR - Automator - Remove tags by label type
* MINOR - Automator - Remove tags by label type
* MINOR - Automator - Remove tags by label type
---------
Co-authored-by: Aniket Katkar <aniketkatkar97@gmail.com>
* Use namespaced variables
* Fix test
* Add LOG, remove uneeded catch
* Add Log, Refactor VariableHandler
* Add Validation at Definition time
* Add migration
* Remove comments
* Fix migrations by not setting deployed if workflowHandler is not initialized
* feat(apps): add app config in run record
- changed returned schema type of "status" to "AppRunRecord"!
- added a "config" field in the app record
- added a "pending" stage so that "external" app status can be mapped ti internal app status
* added note about schema compatiblity
* added app config for external apps
* show config for every app run
* add tests
* revert open change for now
* Revert "revert open change for now"
This reverts commit e1492a5c92d1967b3d47230a25df4c2c3d399de2.
* update dependency
---------
Co-authored-by: karanh37 <karanh37@gmail.com>
Co-authored-by: Karan Hotchandani <33024356+karanh37@users.noreply.github.com>
