* Refactor output_handlers to a WorkflowOutputHandler class
* Add old methods as deprecated to avoid breaking changes
* Extract WorkflowInitErrorHandler from workflow_output_handler
* Fix static checks
* Fix tests
* Fix tests
* Update code based on comments from PR
* Update comment
* DQ BaseWorkflow
* Test suite runner
* test Suite workflow
* Refactor DQ for BaseWorkflow
* Lint
* Fix source
* Fix source
* Fix source
* Fix source
* Fix test
* Fix test
* Fix test
* Update airflow loggers and rename ometa loggers
* ANSI print to logger
* Remove colored logging from tests
* Merge ometa_logger into the one used in loggers class
* linting
* linting
Co-authored-by: Nahuel Verdugo Revigliono <nahuel@getcollate.io>
* Fix#6141: Ingestion Pipeline Status Updates
* List Pipeline Status API & Improvements
* Rename State field to PipelineState in UI
* Convert Pipeline Status array to single object
* fix braking UI
* Rebase Fixes
* Profiler, TestStuite & DataInsigts Pipeline
* py_format
* fix logs page not loading
add pipelineStatus endpoint
* fix recent run changes
* Fix Tests
* address review comments for ui
* fix failing checks
* fix unit tests
* fix cypress test
* remove loader test as not using it
* wait for API when we click on the tab
* fix cypress waitFor api
* fix failed cypress tests
Co-authored-by: Chirag Madlani <12962843+chirag-madlani@users.noreply.github.com>
* Added database filter in workflow
* Removed association between profiler and data quality
* fixed tests with removed association
* Fixed sonar code smells and bugs
* Updated profiler workflow to:
- support only running profiler (removed test run)
- support column inclusion and exclusion
- added back support for partitioned table and sample
* moved status to workflow
* Fixed tests
* removed test logic from profiler sink
* Added logic to return sample from workflow sample value
* Added profiler examples
* Updated documentation for profiler
* Fixed code smells
* commited changed to profiler
* initial commit of the revamp workflow
* Fixed python formating
* cleaned up profiler submodule by removing test related files and functions
* Added airflow DAG logic for testSuite workflow
* Fixed code smells + added airflow ingestion tests + fixed comments