147 Commits

Author SHA1 Message Date
Onkar Ravgan
335aa86fcc
fixed athena e2e (#14041) 2023-11-20 21:20:32 +05:30
Onkar Ravgan
b781c66206
Fixed tableau e2e counts due to new sample data in the instance (#14039)
* fixed tableau e2e new

* rmv hive test
2023-11-20 19:54:06 +05:30
Mayur Singal
4b625f7ba5
Move pandas top level import (#13926) 2023-11-10 14:15:14 +05:30
Ayush Shah
ad86d8969f
Fix E2E failures (#13648) 2023-10-19 17:49:02 +05:30
Ayush Shah
f94e2dbb47
Fix Hive Bytes issue, add athena yaml, fix bigquerymultiple project id token issue (#13640) 2023-10-18 23:48:21 +05:30
Ayush Shah
ac9e8c9e89
Add E2E - Oracle, Athena. Remove Duplicated code (#13563) 2023-10-18 16:57:06 +05:30
Mayur Singal
f63881b8b6
Fix mysql E2E test count (#13529) 2023-10-12 11:25:14 +05:30
Mayur Singal
f69cd9f54a
Fix hive e2e test count (#13497) 2023-10-10 00:21:23 -07:00
Pere Miquel Brull
f5e10c4a5f
Fix #7272 - BaseWorkflow docs and cleanup (#13471)
* DQ BaseWorkflow

* Test suite runner

* test Suite workflow

* Refactor DQ for BaseWorkflow

* Lint

* Fix source

* Fix source

* Fix source

* Fix source

* Fix test

* Prepare docs

* Clean sink

* Clean legacy classes

* typo

* ProcessorStatus
2023-10-09 07:05:05 +02:00
Pere Miquel Brull
0282574bdd
Create ometa client once and pass it around & improve pycln config (#13310)
* Create ometa client once and pass it around & improve pycln config

* Fix

* Fix

* Fix tests

* Fix maven ci

* Fix tests

* Fix tests

* Fix tests

* Format

* Fix DI
2023-10-04 09:14:03 +02:00
Mayur Singal
4f4d1c725c
Fix failing E2Es (#13419) 2023-10-04 10:56:34 +05:30
Pere Miquel Brull
f0995cbddc
Part of #12998 - Prep Stored Procedures Skeleton for Snowflake (#13121)
* Prep Stored Procedures Skeleton for Snowflake

* Update pylint and add migrations

* Fix test

* Reuse source url computation
2023-09-12 14:25:42 +02:00
Ayush Shah
3d4a3cbb95
add mysql e2e changes (#13145) 2023-09-12 11:55:19 +05:30
Pere Miquel Brull
66a89ffe61
Fix e2e profiler status (#13127) 2023-09-10 18:46:28 +02:00
Mayur Singal
011eaf8ad5
Fix #13001: Fix query not populating to all tables (#13004) 2023-09-05 14:16:37 +05:30
Ayush Shah
dc8e59eba8
Fix E2E - dashboards (#13082) 2023-09-04 23:25:31 +05:30
gauthk6
ba2201f4ea
draft: implementation of lightdash connector. (#12957)
* Fixes a bug while patching the description of a TestCase

* Update docker-compose.yml

* Update docker-compose.yml

* Ran pre-commit checks and linter

* Added some clarifying points and fixed some grammatical errors in the documentation for installation instructions.

* revert changes made to docs

* implementation of lightdash connector.

* ui: add icon for lightdash service

* chore: update lightdash image

* chore: update the icon

* Cleaned up code (took out debug statements, etc.). Still TODO: yield_dashboard_lineage_details() not being called just yet.

* fix: ran linting

* added null checks

* Delete openmetadata-server.md

---------

Co-authored-by: Sachin Chaurasiya <sachinchaurasiyachotey87@gmail.com>
Co-authored-by: Teddy <teddy.crepineau@gmail.com>
2023-08-31 17:28:07 +02:00
Pere Miquel Brull
1188831cd5
Fix e2e for tableau, metabase and powerbi (#13050)
* Fix e2e

* Fix e2e
2023-08-31 15:45:41 +02:00
Pere Miquel Brull
a5667bb585
Fix import (#13044) 2023-08-31 08:30:18 +02:00
Pere Miquel Brull
6c0e9f5061
Part of #7272 - Centralize Workflows, Status, and Exception Management (#13029)
* Prep changes

* Prep changes

* prep changes

* Update imports

* Format

* Prep delete

* Prep delete

* Fix sink

* Prep test

* Commit

* passing either

* passing either

* Prep Either

* Metadata source with Either

* Update status

* Merge remote-tracking branch 'upstream/main' into issue-7272

* Format

* Linting

* Linting

* Linting

* Linting

* Fix tests

* Fix tests

* Fix tests

* Fix tests

* Fix tests

* Fix tests

* Fix tests

* Comments
2023-08-30 15:49:42 +02:00
Ayush Shah
407900e5b4
Fix e2e according to latest changes (#13018) 2023-08-29 10:23:23 +05:30
Ayush Shah
300347fdd3
Fix mysql e2e (#13010) 2023-08-28 23:14:22 +05:30
Ayush Shah
1e2d93a604
Fix #12479: MariaDB Mysql Time Col profiler issues + fix e2e tests (#12868) 2023-08-14 17:28:09 +05:30
Ayush Shah
5ea4de646c
Fix Postgres Profiler for incompatible versions (#12795) 2023-08-11 15:32:43 +05:30
Ayush Shah
ab1ec50c2c
Fixes Mssql Ntext, text and Image (#12490) 2023-07-20 13:34:35 +05:30
Ayush Shah
adde9a1d30
Update py-cli-e2e-tests.yml (#12338) 2023-07-10 14:19:17 +05:30
Ayush Shah
b3ebe3f2ea
Add Datalake E2E (#12323) 2023-07-07 09:13:18 +05:30
Onkar Ravgan
bee0cc4053
Fixed e2e count (#12276) 2023-07-04 20:17:51 +05:30
Onkar Ravgan
15e76bc0d0
Added table level test e2e (#12273) 2023-07-04 12:16:09 +02:00
Mayur Singal
d91a01a666
Fix vertica e2e test (#12195) 2023-06-28 14:04:27 +05:30
Ayush Shah
b764641a97
Connection Doc modifications - mysql, postgres & Mysql E2E fix (#12193)
* Fix Mysql E2E

* Fix Docs

* modify Security.md
2023-06-28 13:48:10 +05:30
Teddy
76f5d3d571
Fixes #11994 - Update dbt and GE integration with new DQ flow (#12018)
* feat: updated GE integration to match new test workflow

* feat: updated unit tests to match new signature

* feat: added GE integration tests

* feat: ran python linting

* feat: updated dbt ingestion to match new TestSuite workflow

* feat: ran python linting

* feat: remove testSuite from Elasticsearch event test case update

* feat: ran java linting
2023-06-19 15:05:51 +02:00
Ayush Shah
f80eaf3a26
Fixes 11068: mysql & postgres iam auth (#11937) 2023-06-16 13:18:12 +05:30
Teddy
8ad8001da1
skip dbt cli e2e (#11999)
* skip dbt cli e2e

* ran linting
2023-06-16 09:20:35 +02:00
Teddy
db59207ffe
temporarly disable dbt test while working on #11895 (#11997) 2023-06-15 20:27:44 +02:00
Onkar Ravgan
d409c339e4
Fix 10689: Added Powerbi Datamodels (#11923) 2023-06-14 17:00:08 +05:30
Ayush Shah
65f370e4aa
Rename GCS to GCP (#11812) 2023-06-06 11:57:00 +05:30
Pere Miquel Brull
0a8b28ab7e
Fix redshift e2e with new lineage info (#11843)
* Fix redshift e2e

* Format

* Format
2023-06-01 09:44:27 +02:00
Pere Miquel Brull
3966238703
Remove e2e system metrics test (#11838) 2023-05-31 18:02:17 +02:00
Pere Miquel Brull
158250353b
Fix hive e2e tests (#11815)
* Fix hive e2e tests

* Fix hive e2e tests
2023-05-30 17:15:55 +02:00
Pere Miquel Brull
a00fc7fef3
Increase wait time for system metrics e2e test (#11804) 2023-05-30 10:45:14 +02:00
Onkar Ravgan
efb37fa7af
Fixed tableau e2e (#11716) 2023-05-23 15:36:08 +05:30
Teddy
9f2a02c718
fix: increase sleep delay for system tables (#11704) 2023-05-22 13:43:50 +00:00
Teddy
8c50d1af52
Fixes #4565 - Fetch Metrics from System tables (#11645)
* feat: fetch metrics from system tables

* feat: add permission doc for fetching metrics from system tables

* feat: fix E2E tests to reflect full table row count after table metric update

* feat: ran linting

* feat: fix doc string engine name + function typing

* feat: ran python linting
2023-05-22 09:04:18 +02:00
Ayush Shah
ad7258e7be
Fixes 10949: return Chunks for file formats & Centralize logic for different auth configs (#11639)
* Centralize Auth and File formats datalake
2023-05-19 18:54:28 +05:30
Mayur Singal
b53a362772
Increase delay for system metric in e2e tests (#11607) 2023-05-16 06:57:36 +00:00
Mayur Singal
e61bb3cf0d
Fix snowflake E2E: add system metric sleep time (#11569) 2023-05-12 14:09:57 +05:30
Mayur Singal
f7a0d3f5f2
Fix E2E Vertica & System Metric (#11525) 2023-05-10 17:35:55 +05:30
Teddy
60de33d7cf
Fixes #11384 - Implement mem. optimization for sys. metrics (#11460)
* fix: optimize system metrics retrieval for memory

* fix: ran python linting

* fix: logic to retrieve unique system metrics operations

* fix: added logic to clean up query before parsing it

* fix: added E2E tests for rds, bq, snflk system metrics

* fix: ran python linting

* fix: fix postgres query + add default byte size to env var

* fix: ran python linting
2023-05-09 12:05:35 +02:00
Nahuel
3ba29e7f0e
Fix: Redshift E2E tests (#11396) 2023-05-03 08:12:32 +05:30