2535 Commits

Author SHA1 Message Date
Teddy
468721fa8a
change sampling method for snflk (#8336) 2022-10-24 18:26:00 +02:00
Nahuel
36b12bd6f1
Fix lineage issues with merge_into and copy grants queries (#8335) 2022-10-24 17:22:22 +02:00
Pere Miquel Brull
60694bd60f
Disable timeout for windows (#8331) 2022-10-24 08:47:00 +02:00
Sriharsha Chintalapani
d5a9cd4bc1
Issue-8315: Parameter 'input' on the metadata restore CLI not working (#8317) 2022-10-21 21:49:01 -07:00
Suresh Srinivas
229b56e7b3
Fixes #8236 - Initialize bots from JSON data files (#8304) 2022-10-21 08:38:52 -07:00
Onkar Ravgan
0ba3036382
Added DBT col level lineage using queries (#8176)
* Added DBT col level lineage using queries

* Fixed pylint

* removed too many local vars

* Fixed pylint after rebase

Co-authored-by: Onkar Ravgan <onkarravgan@Onkars-MacBook-Pro.local>
2022-10-21 13:57:52 +02:00
Onkar Ravgan
2a85ea4747
Used ES instead of get_by_name (#8288)
Co-authored-by: Onkar Ravgan <onkarravgan@Onkars-MacBook-Pro.local>
2022-10-20 18:16:39 +05:30
Nahuel
8d8ee3cfdd
Improve error messages and update dashboard YAML example files (#8286) 2022-10-20 14:19:58 +02:00
Teddy
030d576df7
Fix test suite bug for redefined quotes (#8248)
* Fixed bug when running test for same table name across different DB

* Fix python check style

* Fixed linting
2022-10-19 16:30:46 +02:00
Onkar Ravgan
d9b50b5be9
Added project id to DBT cloud config (#8062)
* Added project id to DBT cloud config

* added field in cloud config source Dbt config

* fix unit test issue

* Fixed pylint

Co-authored-by: Onkar Ravgan <onkarravgan@Onkars-MacBook-Pro.local>
Co-authored-by: Ashish Gupta <ashish@getcollate.io>
2022-10-19 18:59:33 +05:30
NiharDoshi99
e086fb7c25
Add Domo Database Connector (#8221)
* added domo database connector

* added domo database connector

* changes based on comment
2022-10-19 12:50:58 +02:00
Mayur Singal
0b6e3741b3
Fix Datalake Json Error (#8246) 2022-10-19 14:12:23 +05:30
Pere Miquel Brull
26efe40e87
Add metadata main (#8247) 2022-10-19 10:02:36 +02:00
Milan Bariya
1565aa7733
FIX: Trino&Presto catalogs as databases (#8189)
* FIX: Trino&Presto catalogs as databases

* FIX: Trino&Presto catalogs as databases

* Change based on comments
2022-10-18 20:00:17 +05:30
NiharDoshi99
84a89d7181
Added DOMO Pipeline (#8133) 2022-10-18 17:52:28 +05:30
Milan Bariya
5b3c877dd1
FIX:connection failed because of having '@' character in uname and pass (#8172) 2022-10-17 16:57:55 +05:30
Pere Miquel Brull
d48fd468d4
Tag PATCH + Cleanup of helpers methods (#8150)
* cleanup

* lint

* Add tag patch

* Fix rename

* Dont kill tests
2022-10-15 14:56:30 +02:00
Mayur Singal
b55a46f4de
Fix #5492: Fix Trino Comments (#8113) 2022-10-14 06:39:31 +02:00
Milan Bariya
e7a3770240
Add: databricks usage and lineage added (#7386) 2022-10-14 07:06:28 +05:30
NiharDoshi99
7975f0e6fe
Pylint Fix (#8134)
* Pylint Fix

* changes as per comment
2022-10-13 14:48:28 +02:00
Nahuel
48905a7f6e
Fix#7532: Allow overriding service connection config when ingesting from CLI (#8091)
* Allow overriding service connection config when ingesting from CLI

* Rename field in JSON schema

* Address comment
2022-10-13 12:34:03 +02:00
NiharDoshi99
0e44f7d35d
Fixed: Intergrated DOMO Connector APIs (#7989) 2022-10-13 10:55:48 +05:30
Ayush Shah
aa9ef323e2
FIx Nonetype Bigquery Taxonomy (#8110) 2022-10-12 19:54:13 +05:30
Ayush Shah
58765379a1
Fix Policy Tags from diff project ids (#8004) 2022-10-12 15:17:21 +05:30
Onkar Ravgan
92ddda2c15
Fixed DBT snowflake case sensitivty and dbt owner from manifest (#8052)
* Fixed snowflake case and dbt owner manifest

* Merged main after linting

Co-authored-by: Onkar Ravgan <onkarravgan@Onkars-MacBook-Pro.local>
2022-10-12 14:59:17 +05:30
Milan Bariya
7aaaddf7cc
FIX: Deleted label not appearing for bigquery (#8090) 2022-10-12 12:55:12 +05:30
Pere Miquel Brull
4b3ca065c4
Fix #3394 - Pylint fixes and add it to CI (#8084)
Fix #3394 - Pylint fixes and add it to CI (#8084)
2022-10-11 17:15:02 +02:00
Teddy
f883863b8a
Fixes #7490 - Split Profiler and TestSuite Interface (#8032)
* Clean up test suite workflow and interface

* Fixed tests

* Split profiler and testSuite interfaces

* Cleaned up workflows and runners

* Fixed code formatting

* - remove old code
- remove `table` attribute used for testing and used mock instead

* Fixed execution bugs from refactor

* Fixed static type checking for profiler/api/workflow.py

* Fixed linting

* Added __init__ files
2022-10-11 15:57:25 +02:00
Ashish Gupta
8ddab79dc1
UI :- Remove rc-tree and react-table dependencies (#8049)
* Remove rc-tree and react-table dependencies

* fix unit test issue

* File Formatted

Co-authored-by: Ayush Shah <ayush@getcollate.io>
2022-10-11 15:42:58 +05:30
Teddy
3b7f576d04
Fixed linting for Profiler (#7922)
* - Fixed linting
- Added logic to skip partition check when engine is not BQ
- Added ingestion partition logic to testSuite

* Fixed python formating

* Fixed test for BQ partition
2022-10-11 09:36:36 +02:00
Mayur Singal
22ac150d7b
Database Source Lint (#8034) 2022-10-11 13:05:08 +05:30
Nahuel
806dcea0de
Fix Superset REST client requests (#8058) 2022-10-11 08:23:26 +02:00
Teddy
3c093f65fc
Fixes test suite pylint (#7937)
* Fixed linting for testSuite

* fixed python format

* Fixed conflict
2022-10-11 06:55:14 +02:00
Teddy
d0984c5a43
Fixes lineage linting (#7956)
* Fixed pylint

* Fixed python formating
2022-10-11 06:55:08 +02:00
Mayur Singal
a2894f7990
Dashboard Source Lint (#7987) 2022-10-11 06:50:55 +02:00
Pere Miquel Brull
f031293af0
Fix Pylint ingestion/bulksink and ingestion/stage (#8030)
* Pylint ingestion bulksink

* Pylint stage

* Remove test

* Remove stage
2022-10-10 14:06:43 +02:00
Onkar Ravgan
107eeef8c7
Added fixes according to pylint (#8009)
Co-authored-by: Onkar Ravgan <onkarravgan@Onkars-MacBook-Pro.local>
2022-10-10 12:53:47 +02:00
Nahuel
5c499d2a7a
Add CLI E2E tests for MySQL (#8041)
* Add CLI E2E tests for MySQL

* Fix setup.py and pylint

* Add missing doc and update code after pylint refactor
2022-10-10 11:36:20 +02:00
Pere Miquel Brull
b6ff10f781
Pylint ingestion models (#8029) 2022-10-10 06:51:24 +02:00
Pere Miquel Brull
ab2fabee63
Pylint api (#8040) 2022-10-10 06:50:28 +02:00
Mayur Singal
13f6f79f30
Metadata Source Lint (#8018) 2022-10-10 06:46:59 +02:00
Mayur Singal
b8e989af6c
Pipeline Source Lint (#8002) 2022-10-10 06:46:31 +02:00
Mayur Singal
4e51c70dcc
Messaging & MlModel Source Lint (#8008)
* Messaging Source Lint

* MlModel Source Lint
2022-10-10 06:46:24 +02:00
Teddy
90c569eadc
Removed click.Tuple() and used nargs instead (#8035) 2022-10-07 18:43:07 +02:00
Sriharsha Chintalapani
5be142959a
Fix #8036: Superset ingestion fails during the lineage fetch for charts (#8037) 2022-10-07 18:42:46 +02:00
Pere Miquel Brull
783557e6da
Fix Pylint for ingestion/sink (#7961)
* pylint on sink

* Add missing registration
2022-10-07 07:02:27 +02:00
Teddy
cd6b3d6b8a
Removes support database for Trino Connection (#7973)
* Removes support database for Trino Connection

* Added logic to set catalog or database attribute for connection if not already set
2022-10-06 10:39:23 +02:00
Teddy
e244a241c3
added logic to clean up quotes from table constraints (#7959) 2022-10-05 16:09:33 +02:00
Milan Bariya
cd43f1fdcf
Fix: connector for hive has double dash (#7953) 2022-10-05 12:01:13 +02:00
Teddy
15f7c4aa41
Fix param name for median test (#7942)
* Fixed param name for median test

* Fixed unite test for median DQ
2022-10-05 06:32:28 +02:00