* initial setup for data quality form
* added stepper and form component
* added select/add test suite step form
* added form for table test and cron step
* added data quality table test form flow
* bug fix for profiler
* added column test form
* render right panel information dynamically
* updated test as per new changes
* updated data test id
* Fixed ingestionPipeline
* Fixed pytest + python format
* miner fix, added sql editor
* removed filter for duplicate test check
* miner fix
Co-authored-by: Teddy Crepineau <teddy.crepineau@gmail.com>
* Fix#6936: testPlatforms is required field in testSuite and createTestSuite schema
* Fix#6936: testPlatforms is required field in testSuite and createTestSuite schema
* Fix#6936: testPlatforms is required field in testSuite and createTestSuite schema
* Fix#6936: testPlatforms is required field in testSuite and createTestSuite schema
* Fix#6936: testPlatforms is required field in testSuite and createTestSuite schema
* fixed glossary test
* Fixed sample data ingestion
* Add filters for testCaseResultSuccess
testCaseResultFailed, testCaseResultAborted
* Fix#6936: fix testcase listing
* Fix#6936: fix java style
Co-authored-by: Shailesh Parmar <shailesh.parmar.webdev@gmail.com>
Co-authored-by: Teddy Crepineau <teddy.crepineau@gmail.com>
Co-authored-by: mohitdeuex <mohit.y@deuexsolutions.com>
* Added owner field in DataModel
* Added user in backend
* review comments addressed
Co-authored-by: Onkar Ravgan <onkarravgan@Onkars-MacBook-Pro.local>
* Improve logging in ORM profiler
* Fix failing test
* Updated logging in test_suite module to match company's format
Co-authored-by: Teddy Crepineau <teddy.crepineau@gmail.com>
* Added database filter in workflow
* Removed association between profiler and data quality
* fixed tests with removed association
* Fixed sonar code smells and bugs
* Updated profiler workflow to:
- support only running profiler (removed test run)
- support column inclusion and exclusion
- added back support for partitioned table and sample
* moved status to workflow
* Fixed tests
* removed test logic from profiler sink
* Added logic to return sample from workflow sample value
* Added profiler examples
* Updated documentation for profiler
* Fixed code smells
* commited changed to profiler
* initial commit of the revamp workflow
* Fixed python formating
* cleaned up profiler submodule by removing test related files and functions
* Added airflow DAG logic for testSuite workflow
* Fixed code smells + added airflow ingestion tests + fixed comments
* Fix#6744: allow more than one metadata ingestion workflow
* Rename to markDeletedTablesFromFilterOnly
* ui support for new field markDeletedTablesFromFilterOnly
Co-authored-by: Chirag Madlani <12962843+chirag-madlani@users.noreply.github.com>
* Fix#6571: Add EntityLink for the testCase to ID columns
* Fix#6571: Add EntityLink for the testCase to ID columns
* Fix#6782: Separate TableProfile and ColumnProfile api calls
* Fix#6782: Separate TableProfile and ColumnProfile api calls - fix tests
* Fix#6782: Separate TableProfile and ColumnProfile api calls - fix tests
* Fix setFields
* Fix tests
* Update pipeline status endpoint
* updated ui side as per new schema for profiler tab
* updated profiler details with new API
* Fix Profiler tests and validation errors (#6827)
* add profilerSample field in TableProfile
* add profilerSample field in TableProfile
* get columnProfile with field profile
* get columnProfile with field profile
* Fixed sample data and python tests
* fixed date range filter change issue
* handled empty profiler case
* Added column level test case and results
Co-authored-by: Pere Miquel Brull <peremiquelbrull@gmail.com>
Co-authored-by: Shailesh Parmar <shailesh.parmar.webdev@gmail.com>
Co-authored-by: Ayush Shah <ayush@getcollate.io>
Co-authored-by: Teddy Crepineau <teddy.crepineau@gmail.com>
* Implementation of AWS SSM as secrets manager
* Remove dead code
* Minor fixes
* Allow using default credentials in AWS client
* Fixed py style
* Fixed tests imports
* Minor changes
* Add patch to failing test
* Fix how we were storing dbtConfigSource
* Address PR comments
* Added database filter in workflow
* Removed association between profiler and data quality
* fixed tests with removed association
* Fixed sonar code smells and bugs
* Updated profiler workflow to:
- support only running profiler (removed test run)
- support column inclusion and exclusion
- added back support for partitioned table and sample
* moved status to workflow
* Fixed tests
* removed test logic from profiler sink
* Added logic to return sample from workflow sample value
* Added profiler examples
* Updated documentation for profiler
* Fixed code smells
* Clean Atlas, Amundsen and metadata_rest
* FIX: Based on comment
* Added test case for coverage
* Fixed: Py test
* FIX: Added atlas yaml mapping file
* FIX: Py Test
* FIX: Revert Test
* FIX: Removed as per dataset
* Fix#6571: Add EntityLink for the testCase to ID columns
* Fix#6571: Add EntityLink for the testCase to ID columns
* added entityLink to python tests
* Fix tests
Co-authored-by: Teddy Crepineau <teddy.crepineau@gmail.com>
* Added database filter in workflow
* Removed association between profiler and data quality
* fixed tests with removed association
* Fixed sonar code smells and bugs
