8 Commits

Author	SHA1	Message	Date
Mayur Singal	7760663b22	MINOR: Change ingestion licence header (#20549)	2025-04-03 10:39:47 +05:30
Teddy	58699063db	MINOR -- Fix DQ Partition Issue (#18641) ... * fix: renamed `random_sample` to `get_dataset` and change dunder method access for SQA Table object * fix: removed handle_partition decorator * fix: fixed DQ partition issue + moved to `tablesample` method * style: ran python linting * style: fix python format check issues * feat: added postgres tablesample * style: ran python linting * fix: sampling delta * fix: merge conflicts * fix: resolved conflicts * style: ran python linting * fix: patch orm call in test case * fix: mock build_table_orm call in tests * fix: test case failures and errors * fix: removed unused import * fix: patch typo * fix: trino table schema retrieval * fix: remove tuple context manager for 3.8 test support	2024-11-27 08:50:54 +01:00
Pere Miquel Brull	c68a45e7d8	Create new Auto Classification Workflow (#18610)	2024-11-19 08:10:45 +01:00
Imri Paran	a3d6c1dd20	MINOR: tests(datalake): use minio (#17805) ... * tests(datalake): use minio 1. use minio instead of moto for mimicking s3 behavior. 2. removed moto dependency as it is not compatible with aiobotocore (https://github.com/getmoto/moto/issues/7070#issuecomment-1828484982) * - moved test_datalake_profiler_e2e.py to datalake/test_profiler - use minio instead of moto * fixed tests * fixed tests * removed default name for minio container	2024-09-12 07:13:01 +02:00
Teddy	e4c01c5702	fix: region typo in test (#17766)	2024-09-09 17:54:07 +05:30
Pere Miquel Brull	d8e2187980	#15243 - Pydantic V2 & Airflow 2.9 (#16480) ... * pydantic v2 * pydanticv2 * fix parser * fix annotated * fix model dumping * mysql ingestion * clean root models * clean root models * bump airflow * bump airflow * bump airflow * optionals * optionals * optionals * jdk * airflow migrate * fab provider * fab provider * fab provider * some more fixes * fixing tests and imports * model_dump and model_validate * model_dump and model_validate * model_dump and model_validate * union * pylint * pylint * integration tests * fix CostAnalysisReportData * integration tests * tests * missing defaults * missing defaults	2024-06-05 21:18:37 +02:00
Ayush Shah	b79e5c064b	Fix 15576 - Eval Data Type issue fix (#15702)	2024-04-03 15:51:19 +05:30
Teddy	c7ac28f2c2	Fixes #11357 - Implement profiler custom metric processing (#14021) ... * feat: add backend support for custom metrics * feat: fix python test * feat: support custom metrics computation * feat: updated tests for custom metrics * feat: added dl support for min max of datetime * feat: added is safe query check for query sampler * feat: added support for custom metric computation in dl * feat: added explicit addProper for pydantic model import fo Extra * feat: added custom metric to returned obj * feat: wrapped trino import in __init__ * feat: fix python linting * feat: fix typing in 3.8	2023-11-17 17:51:39 +01:00