3 Commits

Author	SHA1	Message	Date
Pere Miquel Brull	7e98ece3e5	MINOR - Pydantic V2 warnings and better exception msg (#16916)	2024-07-04 14:54:41 +02:00
Imri Paran	2c9aeebcb8	MINOR: add column diff for table diff test case (#16809) ... * feat(table-diff): added column validation added column validation for table diff that will be carried out before running the row level diff. If a diff for the column exists, it will short circuit the test and report. * fixed unit tests * format * - resolve column types more robustly - changed test result metric to include "rows" or "columns"	2024-07-02 10:36:03 +00:00
Imri Paran	b960b60965	Fix #16421: add tableDiff test case (#16554) ... * feat: add tableDiff test case This changed introduces a "table diff" test case which compares two tables and fails if they are not identical. The similarity is made based on a specific "key" (because the test only makes sense when performed on ordered collections). 1. Added the `tableDiff` test definition. 2. Implemented a "runtime" parameters feature which injects additional parameters for the test at runtime. 3. Integration tests (because of course). This feature was not tested end-to-end yet because "array" data * pydantic v2 * format * format * format and added data diff to setup.py * format * fixed param issue which has type ARRAY * fixed runtime_parameter_setter * moved models to parent directory * handle errors in table diff * fixed issue with edit test case * format * added more details to pytest skip * format * refactor: Improve createTestCaseParameters function in DataQualityUtils * fixed unit test * removed unused fixture * removed validator.py * fixed tests * added validate kwarg to tests_mixin * removed "postgres" data diff extra as they interfere with psycopg2-binary * fixed tests * pinned tenacity for tests * reverted tenacity pinning * added ui support for test diff * fixed dq cypress and added edit flow * organized the test case * added dialect support * fixed tests * option style fix * fixed calculation for passing/failing rows * restrict the tableDiff test to limited services * set where to None if blank string * fixed where clause * fixed tests for where clause * use displayName in place of name in edit form * added docs for RuntimeParameterSetter * fixed cypress --------- Co-authored-by: Shailesh Parmar <shailesh.parmar.webdev@gmail.com>	2024-06-20 16:54:12 +02:00