374 Commits

Author SHA1 Message Date
Teddy
c151a34c70
[ISSUE-4659] Add Additional GE Tests to the Profiler (#5506)
* Added table tests 'column count to be between' and 'column name to be in set'

* Added 'column values to be in set' test

* Fixed wrong filed name when invoking TestCaseResult

* Added col min and col max to be between

* Fix formatting

* Fix test after adding column name list to table profile

* Added 'column values sum between' test

* Added 'table column name to exist' test

* Fixed JSON description white space + spelling mistake
2022-06-20 08:54:42 +02:00
Teddy
28336b0a43
Fix #3575 Data Quality - Partitioned Tables (#5441)
Co-authored-by: Teddy Crepineau <teddycrepineau@Teddys-MacBook-Pro.local>
Co-authored-by: Vivek Ratnavel Subramanian <vivekratnavel90@gmail.com>
2022-06-14 12:37:44 -07:00
Pere Miquel Brull
02fece727b
Fix #5307 - Define a better topology for Ingestion Sources (#5366)
Fix #5307 - Define a better topology for Ingestion Sources (#5366)
2022-06-13 12:17:54 +02:00
Snyk bot
c717cb1545
fix: ingestion/tests/integration/lineage/airflow/requirements.txt to reduce vulnerabilities (#5178)
The following vulnerabilities are fixed by pinning transitive dependencies:
- https://snyk.io/vuln/SNYK-PYTHON-FLASKAPPBUILDER-2433100
2022-06-08 13:36:31 -07:00
Pere Miquel Brull
8e9d0a73f6
Fix #3573 - Sample Data refactor & ORM converter improvements (#5265)
Fix #3573 - Sample Data refactor & ORM converter improvements (#5265)
2022-06-08 16:10:40 +02:00
Milan Bariya
ec1aca926a
Fix #5210: Review database field for connectors (#5225)
* Fix #5210: Review database field for connectors
2022-06-06 10:48:23 +05:30
Pere Miquel Brull
9138c70dee
Fix #4696 - Only store URL suffixes when extracting metadata (#5281)
* Only store URL suffix

* Fix test service name
2022-06-03 11:43:40 +02:00
Mayur Singal
b3428771a3
Fix #4767: Refactor Usage & Lineage (#5190)
Fix #4767: Refactor Usage & Lineage (#5190)
2022-06-03 10:12:28 +02:00
Onkar Ravgan
4671ca00b0
Refactored PowerBi Connector (#5107)
Refactored PowerBi Connector (#5107)
2022-06-01 10:36:12 +02:00
Abhishek Pandey
50409eac24
removed-required-from-aws-credential (#5219)
removed-required-from-aws-credential (#5219)
2022-05-31 08:45:02 +02:00
Abhishek Pandey
12e8a1fcf6
required-fields-updated-in-snowflake-and-athena (#5143)
required-fields-updated-in-snowflake-and-athena (#5143)
2022-05-30 14:57:26 +02:00
Pere Miquel Brull
0005bc1292
Fix #5108 - Add Map and Struct support for Athena & Block them for profiler (#5181)
Fix #5108 - Add Map and Struct support for Athena & Block them for profiler (#5181)
2022-05-30 06:53:16 +02:00
Sriharsha Chintalapani
cf3d4314dd
Fix #1607 Operational metrics for OpenMetadata system observability (#4386)
Co-authored-by: Akash-Jain <Akash.J@deuexsolutions.com>
2022-05-27 15:39:13 +05:30
Pere Miquel Brull
02c2dd9494
Fix #4689 - Rename FQDN to FQN and clean unused code (#5165) 2022-05-26 21:00:18 +02:00
Teddy
bbe5cfa9e7
[ISSUE-3450] openmetadata-ingestion great-expectations submodule (#4752)
[ISSUE-3450] openmetadata-ingestion great-expectations submodule (#4752)
2022-05-26 15:16:03 +02:00
Mayur Singal
f9bb54ed91
Fix #5162: Sample usage fixed (#5163)
* Fix #5162: Sample usage fixed

* Test Fix
2022-05-26 15:15:41 +02:00
mosiac1
a47a2ce5b7
Add backend and UI support for direct joins between tables (#4943) 2022-05-25 23:41:26 -07:00
Pere Miquel Brull
35e67890b8
Fix #5141 - Iterate over all Entities in the profiler workflow (#5146)
Fix #5141 - Iterate over all Entities in the profiler workflow (#5146)
2022-05-26 07:35:23 +02:00
Mayur Singal
41ee3a5aaf
Fix #3940 : Refractor Sql Source (#5046)
Fix #3940 : Refractor Sql Source (#5046)
2022-05-25 15:41:38 +02:00
Pere Miquel Brull
8e121fb306
Fix #4096 - PipelineService JSON refactor & Airflow metadata source connector (#5125)
Fix #4096 - PipelineService JSON refactor & Airflow metadata source connector (#5125)
2022-05-25 08:35:16 +02:00
Abhishek Pandey
0a69a82b98
issue-3828: updated-workflow-and-stage-test (#5117) 2022-05-25 07:40:22 +02:00
Abhishek Pandey
8fd69e7eb8
source-connection-test-updated (#5126) 2022-05-25 07:36:00 +02:00
Pere Miquel Brull
753d901fb2
Fix Python tests & flakiness (#5095)
Fix Python tests & flakiness (#5095)
2022-05-23 14:54:47 +02:00
Pere Miquel Brull
cd35447792
Fix #4688 - Python FQN with ANTRL & ES (#5073)
Fix #4688 - Python FQN with ANTRL & ES (#5073)
2022-05-23 09:51:34 +02:00
codingwithabhi
da92d07c78
source-connection-unitest-added (#4916) 2022-05-13 13:48:04 +05:30
Pere Miquel Brull
52dac4ab37
Fix #4905 - Glue db and filters (#4907)
Fix #4905 - Glue db and filters (#4907)
2022-05-12 15:49:03 +02:00
Milan Bariya
d1f21911f5
Add: Unit Test source for multiple conn (#4845)
Add: Unit Test source for multiple conn (#4845)
2022-05-12 14:31:09 +02:00
Milan Bariya
0acf88e1ba
ISSUE-1072: Add Apache Pinot support (#4649)
* ISSUE-1072: Add Apache Pinot support

* ISSUE-1072: Add Apache Pinot support

* Rename pinotdbConnection.json to pinotDBConnection.json
2022-05-11 11:13:28 +02:00
codingwithabhi
79b10081d7
mssql-unittest-added (#4851)
mssql-unittest-added (#4851)
2022-05-11 07:25:49 +02:00
Pere Miquel Brull
14e09bd1cc
Fix #4821 - Validate Server and Client versions (#4847) 2022-05-10 09:15:33 -07:00
Ayush Shah
a4212ec356
Revamp Snowflake (#4653)
Revamp Snowflake (#4653)
2022-05-09 15:54:36 +02:00
Mayur Singal
7e684a91eb
Fixed #4769: Trino Connection Argument Fix (#4794)
* Fixed #4769: Trino Connection Argument Fix

* Added tests

* Imporved test with proxy and without conn args
2022-05-09 12:46:03 +02:00
Pere Miquel Brull
04421901c0
[WIP] Fix #4610 - Pipeline Tasks removal (#4615)
Co-authored-by: Sriharsha Chintalapani <harsha@getcollate.io>
2022-05-07 21:10:35 -07:00
Pere Miquel Brull
a22ff4627f
Fix #4728 - Fix Kafka test connection (#4730)
* Fix Kafka connection

* Update defaults and required values

* Update test connection

* Add filter tests

* Fix kafka tests
2022-05-06 08:59:05 +02:00
Mayur Singal
450fb2b132
SampleData Usage Fix (#4398)
* SampleData Test Connection & Usage Fix

* Fixed Pytest
2022-05-04 16:45:49 +02:00
Ayush Shah
5cf9799578
Modify redshift schema (#4624) 2022-05-03 16:27:07 +05:30
Pere Miquel Brull
f3c107025a
Fix #4540 - Parse connection JSON gracefully (#4591)
* Parse connection JSON gracefully

* Only check parsing

* Format
2022-04-29 09:20:10 -07:00
codingwithabhi
897e4ff765
snowflake-private-key-fix-via-ui (#4492)
* snowflake-private-key-fix-via-ui

* removed-overriding-test-connection

* code-formatted
2022-04-26 17:10:10 +05:30
Mayur Singal
355e6dc6b0
Fixed Druid Source Connector (#4476) 2022-04-25 06:46:35 -07:00
Ayush Shah
4d2bde4fe7
Fixes Tableau - added env with default value (#4408) 2022-04-23 21:53:13 +05:30
Pere Miquel Brull
dbdd3caf1d
Fix #4332 - Athena LEN & hist concat cast + disable (#4371) 2022-04-22 20:29:59 +05:30
Ayush Shah
a94bb5fc8e
Fixes Tableau + fix Charts not getting ingested as part of dashboard (#4327)
* Fixes Tableau + fix Charts not getting ingested as part of dashboard

* pytest fix

* Fix Tableau json config
2022-04-22 12:49:55 +02:00
Pere Miquel Brull
ca0b26dded
Fix #4313 - Add title to connection schemas; Fix #4335 - AWS Credentials (#4338)
Fix #4313 - Add title to connection schemas; Fix #4335 - AWS Credentials (#4338)
2022-04-22 11:25:05 +02:00
Mayur Singal
db0e34c709
Fixing Test Connection for Dynamo & Glue (#4316)
* Fixing Test Connection for Dynamo

* Fixed Glue Connector

* renamed engine to connection

* Fixed the return signature

* Added dataclass
2022-04-22 11:30:59 +05:30
Onkar Ravgan
0536cdedcf
Fixes for vertica password issue and added connection url test (#4323)
* rebase with main

* optimized password logic and added tests

Co-authored-by: Onkar Ravgan <onkarravgan@Onkars-MacBook-Pro.local>
2022-04-22 07:38:35 +02:00
Pere Miquel Brull
2444d3de3d
Fix #4235 - Run data profiler workflows from Airflow REST (#4325)
Fix #4235 - Run data profiler workflows from Airflow REST (#4325)
2022-04-21 17:53:29 +02:00
Ayush Shah
09f01fc7e3
Issue 4237 - fixes empty dictionary (#4239) 2022-04-19 21:22:46 +05:30
Pere Miquel Brull
256b16d877
Fix #4032 - Bigquery properties & GCS Credentials (#4202)
Fix #4032 - Bigquery properties & GCS Credentials (#4202)
2022-04-19 12:31:34 +02:00
Milan Bariya
924e211ba1
ISSUE-4076: Use the central get_engine method for usage (#4180)
* ISSUE-4076: Use the central get_engine method for usage

* ISSUE-4076: Use the central get_engine method for usage

* ISSUE-4076: Use the central get_engine method for usage

Co-authored-by: Pere Miquel Brull <peremiquelbrull@gmail.com>
Co-authored-by: Mayur Singal <39544459+ulixius9@users.noreply.github.com>
2022-04-19 12:35:01 +05:30
Pere Miquel Brull
63415952e3
Fix sample data (#4200)
Fix sample data (#4200)
2022-04-18 19:00:36 +02:00