3 Commits

Author	SHA1	Message	Date
Teddy	58699063db	MINOR -- Fix DQ Partition Issue (#18641) ... * fix: renamed `random_sample` to `get_dataset` and change dunder method access for SQA Table object * fix: removed handle_partition decorator * fix: fixed DQ partition issue + moved to `tablesample` method * style: ran python linting * style: fix python format check issues * feat: added postgres tablesample * style: ran python linting * fix: sampling delta * fix: merge conflicts * fix: resolved conflicts * style: ran python linting * fix: patch orm call in test case * fix: mock build_table_orm call in tests * fix: test case failures and errors * fix: removed unused import * fix: patch typo * fix: trino table schema retrieval * fix: remove tuple context manager for 3.8 test support	2024-11-27 08:50:54 +01:00
Imri Paran	bde6ee4125	MINOR: Data diff sample fix (#18632) ... * fix(data-diff): sampling configuration handle the sampling condition separately for the 2 tables allowing to apply sampling on columns with mismatching cases * format	2024-11-15 08:22:13 +01:00
Imri Paran	cdaa5c10af	[GEN-1996] feat(data-quality): use sampling config in data diff (#18532) ... * feat(data-quality): use sampling config in data diff - get the table profiling config - use hashing to sample deterministically the same ids from each table - use dirty-equals to assert results of stochastic processes * - reverted missing md5 - added missing database service type * - use a custom substr sql function * fixed nounce * added failure for mssql with sampling because it requires a larger change in the data-diff library * fixed unit tests * updated range for sampling	2024-11-11 10:07:23 +01:00