16 Commits

Author SHA1 Message Date
Imri Paran
25284e0232
MINOR: fix snowflake system metrics (#17989)
* fix snowflake system metrics

* format

* add link to logs and commit
fixed the dq cli test

* reverted bad formatting

* fixed models.py

* removed version pinning for data diff in tests
2024-09-26 11:55:17 +00:00
Imri Paran
21af02d8d5
Fix 17903: fix(data-quality): snowflake data diff (#17907)
* fix(data-quality): snowflake data diff

- fixed schema in snowflake URL for data diff
- added e2e for snowflake data quality

* reverted unintended change
2024-09-19 17:55:48 +02:00
Imri Paran
1b833e1a01
MINOR: exclude information_schema in redshift (#16818)
* fix(redshift): exclude information_schema

exclude information_schema in tests and document it as best practice.

* format
2024-06-28 08:01:52 +02:00
Pere Miquel Brull
f5e10c4a5f
Fix #7272 - BaseWorkflow docs and cleanup (#13471)
* DQ BaseWorkflow

* Test suite runner

* test Suite workflow

* Refactor DQ for BaseWorkflow

* Lint

* Fix source

* Fix source

* Fix source

* Fix source

* Fix test

* Prepare docs

* Clean sink

* Clean legacy classes

* typo

* ProcessorStatus
2023-10-09 07:05:05 +02:00
Pere Miquel Brull
6c0e9f5061
Part of #7272 - Centralize Workflows, Status, and Exception Management (#13029)
* Prep changes

* Prep changes

* prep changes

* Update imports

* Format

* Prep delete

* Prep delete

* Fix sink

* Prep test

* Commit

* passing either

* passing either

* Prep Either

* Metadata source with Either

* Update status

* Merge remote-tracking branch 'upstream/main' into issue-7272

* Format

* Linting

* Linting

* Linting

* Linting

* Fix tests

* Fix tests

* Fix tests

* Fix tests

* Fix tests

* Fix tests

* Fix tests

* Comments
2023-08-30 15:49:42 +02:00
Pere Miquel Brull
0a8b28ab7e
Fix redshift e2e with new lineage info (#11843)
* Fix redshift e2e

* Format

* Format
2023-06-01 09:44:27 +02:00
Pere Miquel Brull
3966238703
Remove e2e system metrics test (#11838) 2023-05-31 18:02:17 +02:00
Pere Miquel Brull
a00fc7fef3
Increase wait time for system metrics e2e test (#11804) 2023-05-30 10:45:14 +02:00
Teddy
9f2a02c718
fix: increase sleep delay for system tables (#11704) 2023-05-22 13:43:50 +00:00
Mayur Singal
b53a362772
Increase delay for system metric in e2e tests (#11607) 2023-05-16 06:57:36 +00:00
Mayur Singal
f7a0d3f5f2
Fix E2E Vertica & System Metric (#11525) 2023-05-10 17:35:55 +05:30
Teddy
60de33d7cf
Fixes #11384 - Implement mem. optimization for sys. metrics (#11460)
* fix: optimize system metrics retrieval for memory

* fix: ran python linting

* fix: logic to retrieve unique system metrics operations

* fix: added logic to clean up query before parsing it

* fix: added E2E tests for rds, bq, snflk system metrics

* fix: ran python linting

* fix: fix postgres query + add default byte size to env var

* fix: ran python linting
2023-05-09 12:05:35 +02:00
Teddy
afce5fa61b
Fix E2E tests (#11267)
* fix: profile only include schema

* tests: add logic to handle exsiting views and table for Hive

* fix: python linting
2023-04-25 16:05:49 +02:00
Teddy
6f5d88ff63
tests: Added E2E tests for redshift (#11169) 2023-04-21 08:55:54 +02:00
Teddy
c415f04eb7
Issue 10805 profiler e2e mssql (#11096)
* feat: extracted builder logic into factory and cleaned up comments

* feat: added E3E logic for time based profiler partition + logic for testing detailed profiler results
2023-04-18 11:56:16 +02:00
Nahuel
ea70580aff
Fix#10584: Tableau E2E and docs (#11054) 2023-04-14 19:28:31 +05:30