7 Commits

Author	SHA1	Message	Date
Ayush Shah	9880f06b2c	Fixes #17489: Allow non numeric numbers to be sent via Json, Replace NaN value… (#17490) ... * fix: Allow non numeric numbers to be sent via Json, Replace NaN values with None in SQAProfilerInterface Replace NaN values with None in the SQAProfilerInterface class to maintain database parity. NaN values will be cast to null in OpenMetadata. This change ensures that data handling processes account for this conversion. * fix: histogram overflow error * test: Add Unit Test for Null and Null Ratio Metric * chore: Address comments * chore: Address comments * fix: checkstyle and message * fix: failing tests as null count works as expected	2024-08-20 16:33:55 +05:30
Pere Miquel Brull	d8e2187980	#15243 - Pydantic V2 & Airflow 2.9 (#16480) ... * pydantic v2 * pydanticv2 * fix parser * fix annotated * fix model dumping * mysql ingestion * clean root models * clean root models * bump airflow * bump airflow * bump airflow * optionals * optionals * optionals * jdk * airflow migrate * fab provider * fab provider * fab provider * some more fixes * fixing tests and imports * model_dump and model_validate * model_dump and model_validate * model_dump and model_validate * union * pylint * pylint * integration tests * fix CostAnalysisReportData * integration tests * tests * missing defaults * missing defaults	2024-06-05 21:18:37 +02:00
Teddy	449a5f2de3	FIX #11951 - ingestion logic for global profiler config (#15948) ... * feat: add global metric configuration for the profiler * style: ran java linting * fix: renamed disable to disabled * style: ran java linting * feat: ometa sdk for profiler setting * test: ingestion profiler global config tests * fix: update metric name to use MetricType Enum * fix: allow bot to retrieve settings * fix: exclude GX artifacts * feat: implement global profiler setting logic for ingestion side * fix: exclude metrics if Metric is empty * style: ran python linting * style: ran python linting * fix: skip empty metrics * style: ran python linting * fix: moved GET profiler config to seperate endpoint in system resource * fix: moved compute metric filter to MetricFilter + renamed container * fix: test failures * fix: profiler test case	2024-04-22 22:35:37 +02:00
Pere Miquel Brull	db985fda57	MINOR - Snowflake system queries to work with ES & IDENTIFIER (#14864)	2024-01-26 18:41:16 +05:30
Teddy	c7ac28f2c2	Fixes #11357 - Implement profiler custom metric processing (#14021) ... * feat: add backend support for custom metrics * feat: fix python test * feat: support custom metrics computation * feat: updated tests for custom metrics * feat: added dl support for min max of datetime * feat: added is safe query check for query sampler * feat: added support for custom metric computation in dl * feat: added explicit addProper for pydantic model import fo Extra * feat: added custom metric to returned obj * feat: wrapped trino import in __init__ * feat: fix python linting * feat: fix typing in 3.8	2023-11-17 17:51:39 +01:00
Mayur Singal	a8145a82fa	Fix #13603: Configurable Sample Data Rows for Profiler (#13807) ... * Fix #13603: Configurable Sample Data Rows * Fix #13603: Configurable Sample Data Rows for Profiler * fix table config * support configurable overwriting of sample data * add support for schema and database profiler configuration * chore(ui): put sampleDataStorageConfig under advanced config * fix tests * py format * chore(ui): add sampleDataCount in table profiler config * fix tests * pylint & tests * feat(ui): add profiler settings tab in database and database schema page * chore(ui): show different inputs for profile sample type * schema changes to make default storange config null * add unit test * schema changes to fix api * update profiler setting schema * move profiler settings to manage button * sync locals * fix(ui): unit tests * fix tests * py format * fix lint * minor improvements * chore(ui): update profiler settings schema * resolve review comments * pytest --------- Co-authored-by: Sachin Chaurasiya <sachinchaurasiyachotey87@gmail.com>	2023-11-09 18:49:42 +05:30
Teddy	b89cf64f14	Clean up profiler (#12369) ... * ref: implemented interface for profiler components + removed struct logic * ref: ran python linting * ref: added UML diagram to readme.md * ref: empty commit for labeler check * ref: remove multiple context manager for 3.7 3.8 compatibility * ref: remove	2023-07-12 17:02:32 +02:00