* Initial implementation for Governance Workflows
* Remove file that shouldn't be there
* Initial implementation for the governance workflows
* Refactor JSONSchema for Governance Workflows
* Refactored WorkflowInstanceStatus to keep the stage properly
* Fix Migration for MySQL for the WorkflowInstanceStates change
* Update WorkflowInstanceState to track all the states propertly
* Initial code tro migrate Request type of Tasks
* copy governance schemas into json directory
* update schema names
* Extract WorkflowInstance into its own resource
* Update WorkflowInstance to have the workflow starting variables
* Changed relatedEntity to be an EntityLink
* First iteration on checkEntityAttributes JSONLogic
* Refactored Workflow into TriggerWorkfow and MainWorkflow
* Fixed WorkflowInstance and WorkflowInstanceState
* Fixed WorkflowInstance and WorkflowInstanceState when process is terminated
* Fix UserTask
* json logic changes to workflow
* Fix Patch request. Add exclude filter to EventBasedEntityTrigger
* update query builder
* Fix Migrations
* Fix Migrations
* modify query builder widget
* fix search props
* update widget and use default fields
* Update edges to always have a true/false condition
* made changes to provider for fields
* push progress
* fix grouping of array field
* Remove duplicated migrations
* Fix migrations
* Fix migrations
* Fix Tests and commit some improvements suggestion
* fix unit tests
* Add Certification Workflow
* Fix Tests
* Fix Tests
* fix tests
* add delay in pagination tests
* fix minor config changes for json logic
* change the glossary page
* Remove Table Certification Workflow seed Data
* add json logic and elastic search parsers
* minor schedule interval changes for workflows
* minor fixes to the parsing logic
* certification ui
* fix tests
* fix tests
* add other search fields
* Add Certification to search index
* Update index mapping for certification
* add quick filter for certification
* update locales
* Fix index mapping
* Add missing index updates
* Fix checkstyle
* increase timeout
* skipping user test
* skipping team test
---------
Co-authored-by: karanh37 <karanh37@gmail.com>
Co-authored-by: Karan Hotchandani <33024356+karanh37@users.noreply.github.com>
Co-authored-by: Sriharsha Chintalapani <harshach@users.noreply.github.com>
Co-authored-by: sonikashah <sonikashah94@gmail.com>
Co-authored-by: sonika-shah <58761340+sonika-shah@users.noreply.github.com>
* Improve parallelization in SearchIndexApp
* Improve parallelization in SearchIndexApp
* add countdown latch
* typo
* Status issues - #1
* Improve search indexing
* cleanup the code
* schemas
* Status Updates Via WebSockets
* Add Updates
* Make Logs Debug
* show duration in table
* add searchIndexApp params to openmetadata-ops.sh reindex commandline
* Fix code style
* Add Parallel Entity Level Reader
* Make code more readable
* Send App Run Record instead of jobData
* Sned App Run Record WebSocket for Data Insights
* ui: use socket connection to get the real-time updates of application data
* Send WebSocket Final Update
* ui: remove failedRecords, totalRecords and successRecordsfrom entities record
* Invert Condition
---------
Co-authored-by: mohitdeuex <mohit.y@deuexsolutions.com>
Co-authored-by: Pere Miquel Brull <peremiquelbrull@gmail.com>
Co-authored-by: karanh37 <karanh37@gmail.com>
Co-authored-by: Sachin Chaurasiya <sachinchaurasiyachotey87@gmail.com>
Co-authored-by: Mohit Yadav <105265192+mohityadav766@users.noreply.github.com>
* Add export apis back and new apis should be called exportAsync
* ui: use exportAsync endpoint for export assets
* fix build failure
---------
Co-authored-by: Sachin Chaurasiya <sachinchaurasiyachotey87@gmail.com>
Co-authored-by: sonikashah <sonikashah94@gmail.com>
* fix create admin page data and fields
* fix issue around adminFlag undefined
* remove roles filed in case of admin listing game
---------
Co-authored-by: Shailesh Parmar <shailesh.parmar.webdev@gmail.com>
* Make Export CSV Async API, websocket to push data back
* ui: implement csvExportChannel to receive entity export data via websocket
* ui: update flow to show dialogbox with the response message and once data is available download the file
* minor: remove unused code
* ui: show inline banner for success and error message
* remove unused locale keys
* ui: clear existing csvexport job on sucess
* fix failing UserResourceTest
---------
Co-authored-by: Sachin Chaurasiya <sachinchaurasiyachotey87@gmail.com>
Co-authored-by: sonikashah <sonikashah94@gmail.com>
* Fix#18332: Do not consolidate changes for Parent Entities
* Fix#18332: Do not consolidate changes for Parent Entities
* added no data placeholder when no tags there
* fix failing playwright test due to consolidation changes and added the missing services
* Fix tests
* Fix parent entity change notifications
* Fix tests
* Fix parent entity change notifications
* Fix tests
* Fix tests
---------
Co-authored-by: Ashish Gupta <ashish@getcollate.io>
* Add flake.nix
* Add lockfile for flake
* Update nix environment and document usage
* Add schema for exasol connector
* Add Exasol definitions to databaseService
* Fix error in exasol connector schema
* Add additional connection options/settings to exasol connector
* Add exasol-connector to ui
* Add depdencies for exasol-connector
* Update notes
* Update ingestion code
* Add Basic Documentation for Exasol Connector
* Update flake file
* Add developer notes
* Add python script which can be used as entry point for debugging in ide
* Add config file which can be used for debugging (manual execution)
* Update debug script
* Update developer notes
* Remove old developer notes
* Add .venv to gitignore
* Update dev notes
* Update development notes
* Update ExasolSource
* Establish basic connection to Exasol DB from connector
* Update exasol connector connection settings
* Add service_spec for exasol plugin
* Remove development files
* Remove unused module
* Applied code formatter
* Update exasol dependency constraint(s)
* Add unit test for exasol connection url(s)
* Fixed test expectations for exasol connection url test(s)
* Adjust the test query for the Exasol connection test
* improvement around table constraint modal and added beta tag in tabs
* supported localization key
* improvement around beta tag css
* supported dataType icons for columns
* remove beta flag from the tested tabs
* change icon make as per file standard
* Feat: Move data quality page tabs to left panel
* fixed failing unit test
* fixed failing playwright
* added support for dashboard in enum
* Add support for dashboard in enum and custom pie chart component
- Added support for dashboard in enum by creating a new file `Chart.constants.ts` and exporting the constant `CHART_BASE_SIZE`.
- Updated the `Chart.interface.ts` file to include the `CustomPieChartData` type and the `CustomPieChartProps` interface.
- Added a new file `CustomPieChart.component.tsx` to implement the custom pie chart component.
- Updated the `Color.constants.ts` file to import the `DEFAULT_THEME` from `Appearance.constants`.
- Added a new file `TestCaseStatusPieChartWidget.component.tsx` to implement the test case status pie chart widget.
Related to #18155
* Refactor: Update language translations and add initial entity health matrix
This commit refactors the language translations in the UI, specifically adding translations for "Healthy" and "Unhealthy" in multiple languages. Additionally, it introduces the initial entity health matrix, which includes the counts for healthy and unhealthy entities.
* Refactor: Update language translations and add initial entity health matrix
- Refactor the code to update language translations and add an initial entity health matrix.
- Add a new constant `INITIAL_ENTITY_HEALTH_MATRIX` to represent the initial health matrix of entities.
- Add a new constant `INITIAL_DATA_ASSETS_COVERAGE_STATES` to represent the initial coverage states of data assets.
* Refactor: Update language translations and add initial entity health matrix, added open incident area chart widget
* Refactor: Update language translations and add initial entity health matrix, added open incident area chart widget
* Refactor: Add IncidentTimeChartWidget component and related interfaces
This commit adds a new component called IncidentTimeChartWidget, which is responsible for displaying a chart widget related to incident time metrics. It also includes the necessary interfaces for the component.
The IncidentTimeChartWidget component fetches incident time metrics data from the server and displays it in a custom area chart. It calculates the average time value based on the fetched data and renders it along with the chart.
The commit also includes updates to the Chart.interface.ts and CustomAreaChart.component.tsx files to support the new component.
Issue #TBD
* Refactor: Update language translations and add resolution time and response time translations
* Refactor: Add TestCaseStatusAreaChartWidget component and related interfaces
* implemented filters for dq dashboard
* added description for menu
* move default tab view logic to classBase
* Refactor color variables and add unit test for utility function
* added unit test for dataQualityDashboardAPI
* added unit test for new component
* added unit test for new component
* updated the UI
* added unit test
* Refactor date formatting in KPIChart and DataQualityUtils
This commit refactors the date formatting in the KPIChart component and the DataQualityUtils module. In the KPIChart component, the tickFormatter function in the XAxis component is updated to use an arrow function instead of the formatDate function. In the DataQualityUtils module, the formatDate function is modified to support UTC formatting when necessary. Additionally, two functions, getStartOfDayInMillis and getEndOfDayInMillis, are added to the DateTimeUtils module to calculate the start and end of a day in milliseconds.
* fixed failing unit test
* updated icon
* refactore the code
* update the icon for sql
* fixed java checkstyle
* fixed playwright test
* minor
* fix: entity link accepted characters
* fix: match all characters but `<>|::`
* fix: remove unnecessary negative lookbehind
* fix the test case search not working on add ingestion page in case of special characters in FQN
* style: ran java linting
* fix: failing testst
* style: ran java linting
---------
Co-authored-by: Aniket Katkar <aniketkatkar97@gmail.com>