* Added logic to allow profile data to be ingested when sample data fetching faisl
* Update ingestion/src/metadata/orm_profiler/profiler/core.py
Co-authored-by: Pere Miquel Brull <peremiquelbrull@gmail.com>
Co-authored-by: Pere Miquel Brull <peremiquelbrull@gmail.com>
* Added the docker compose for postgres
* Added changes as per the comments on PR
* Airflow Connectivity to Postgres
* Changes are done as per the comments
* Replocate changes to local dockerfile
* Fixed Airflow Dockerfile
* docker-compose services should wait until OpenMetadata DB is created
* remove unnecesary wait for db service
* Add dependencies to airflow image
* Add missing dependencies to airflow Dockerfile
Co-authored-by: “Vijay” <“vijay.l@deuexsolutions.com”>
Co-authored-by: ulixius9 <mayursingal9@gmail.com>
* initial setup for data quality form
* added stepper and form component
* added select/add test suite step form
* added form for table test and cron step
* added data quality table test form flow
* bug fix for profiler
* added column test form
* render right panel information dynamically
* updated test as per new changes
* updated data test id
* Fixed ingestionPipeline
* Fixed pytest + python format
* miner fix, added sql editor
* removed filter for duplicate test check
* miner fix
Co-authored-by: Teddy Crepineau <teddy.crepineau@gmail.com>
* Fix#6936: testPlatforms is required field in testSuite and createTestSuite schema
* Fix#6936: testPlatforms is required field in testSuite and createTestSuite schema
* Fix#6936: testPlatforms is required field in testSuite and createTestSuite schema
* Fix#6936: testPlatforms is required field in testSuite and createTestSuite schema
* Fix#6936: testPlatforms is required field in testSuite and createTestSuite schema
* fixed glossary test
* Fixed sample data ingestion
* Add filters for testCaseResultSuccess
testCaseResultFailed, testCaseResultAborted
* Fix#6936: fix testcase listing
* Fix#6936: fix java style
Co-authored-by: Shailesh Parmar <shailesh.parmar.webdev@gmail.com>
Co-authored-by: Teddy Crepineau <teddy.crepineau@gmail.com>
Co-authored-by: mohitdeuex <mohit.y@deuexsolutions.com>
* Added owner field in DataModel
* Added user in backend
* review comments addressed
Co-authored-by: Onkar Ravgan <onkarravgan@Onkars-MacBook-Pro.local>
* Improve logging in ORM profiler
* Fix failing test
* Updated logging in test_suite module to match company's format
Co-authored-by: Teddy Crepineau <teddy.crepineau@gmail.com>
* Added database filter in workflow
* Removed association between profiler and data quality
* fixed tests with removed association
* Fixed sonar code smells and bugs
* Updated profiler workflow to:
- support only running profiler (removed test run)
- support column inclusion and exclusion
- added back support for partitioned table and sample
* moved status to workflow
* Fixed tests
* removed test logic from profiler sink
* Added logic to return sample from workflow sample value
* Added profiler examples
* Updated documentation for profiler
* Fixed code smells
* commited changed to profiler
* initial commit of the revamp workflow
* Fixed python formating
* cleaned up profiler submodule by removing test related files and functions
* Added airflow DAG logic for testSuite workflow
* Fixed code smells + added airflow ingestion tests + fixed comments
* Fix#6744: allow more than one metadata ingestion workflow
* Rename to markDeletedTablesFromFilterOnly
* ui support for new field markDeletedTablesFromFilterOnly
Co-authored-by: Chirag Madlani <12962843+chirag-madlani@users.noreply.github.com>
* Fix#6571: Add EntityLink for the testCase to ID columns
* Fix#6571: Add EntityLink for the testCase to ID columns
* Fix#6782: Separate TableProfile and ColumnProfile api calls
* Fix#6782: Separate TableProfile and ColumnProfile api calls - fix tests
* Fix#6782: Separate TableProfile and ColumnProfile api calls - fix tests
* Fix setFields
* Fix tests
* Update pipeline status endpoint
* updated ui side as per new schema for profiler tab
* updated profiler details with new API
* Fix Profiler tests and validation errors (#6827)
* add profilerSample field in TableProfile
* add profilerSample field in TableProfile
* get columnProfile with field profile
* get columnProfile with field profile
* Fixed sample data and python tests
* fixed date range filter change issue
* handled empty profiler case
* Added column level test case and results
Co-authored-by: Pere Miquel Brull <peremiquelbrull@gmail.com>
Co-authored-by: Shailesh Parmar <shailesh.parmar.webdev@gmail.com>
Co-authored-by: Ayush Shah <ayush@getcollate.io>
Co-authored-by: Teddy Crepineau <teddy.crepineau@gmail.com>
