Teddy
989f2911c2
Fixes #7810 - Allow to only pass min or max ( #8474 )
...
* ISSUE-7810 Added default values for min and max
For all data validations on columns:-
min_bound is set to float("-inf"), if there is no next value
max_bound is set to float("inf"), if there is no next value
* Fixed PR errors by removing tuple + added tests
Co-authored-by: demi <deepak1212365@gmail.com>
2022-11-01 13:26:51 +01:00
Onkar Ravgan
5819c45937
Databricks + DBT issue ( #8391 )
...
* Databricks dbt issue fixed
* fixed typo
* Added optimizations
* skipping flaky dashboard test
Co-authored-by: Onkar Ravgan <onkarravgan@Onkars-MacBook-Pro.local>
Co-authored-by: Shailesh Parmar <shailesh.parmar.webdev@gmail.com>
2022-11-01 13:41:41 +05:30
Onkar Ravgan
a6d6cff0d5
Fixed abstract init issue ( #8446 )
...
* abstract init issue fixed
* abstract init issue fixed messaging service
Co-authored-by: Onkar Ravgan <onkarravgan@Onkars-MacBook-Pro.local>
2022-11-01 11:40:08 +05:30
Onkar Ravgan
ddc66c8392
vertica query syntax issue fixed ( #8463 )
2022-11-01 00:16:45 +05:30
Ayush Shah
2d7d89754c
Remove Click and Add ArgParse ( #8182 )
2022-10-31 18:12:26 +05:30
Pere Miquel Brull
f4c20ded32
Ingestion Image - Remove expat version release and CI ( #8447 )
...
* Remove expat version
* Remove expat version
2022-10-31 10:01:05 +01:00
Pere Miquel Brull
bc0ce0cec1
Remove expat version ( #8445 )
2022-10-31 13:55:44 +05:30
Nahuel
3ed6ad8456
Update GID used in ingestion docker images ( #8434 )
2022-10-29 13:03:37 -07:00
Pere Miquel Brull
c8f4d496a5
Airflow exception management ( #8410 )
...
* Airflow exception management
* Airflow exception management
2022-10-28 16:11:23 +02:00
Pere Miquel Brull
f834b28198
patch ingestion image ( #8385 )
2022-10-27 15:10:04 +02:00
Onkar Ravgan
c156c344e6
Fixed incorrect const import ( #8380 )
...
Co-authored-by: Onkar Ravgan <onkarravgan@Onkars-MacBook-Pro.local>
2022-10-27 08:54:00 +02:00
Pere Miquel Brull
6d404ccdc1
Domo Pipeline - Use pipeline ID with display name ( #8374 )
...
* Use pipeline ID with display name
* handle id
* lint
* update test for ID
2022-10-26 21:22:26 +02:00
amymareemc
12bc9df0b2
Issue 4886: Add support for Azure Blob ( #8334 )
...
* Issue 4686: Add support for Azure Blob
* ISSUE-4868: make changes as suggested in PR review
* ISSUE-4868: run py_format
* ISSUE-4868: Make changes to enum and formatting
* ISSUE-4868: fix linting issues and update setup.py
2022-10-26 16:14:51 +02:00
Onkar Ravgan
6f1d02ea56
Fixed dbt test case issue ( #8308 )
...
Co-authored-by: Onkar Ravgan <onkarravgan@Onkars-MacBook-Pro.local>
2022-10-26 05:52:23 -07:00
Nahuel
0e66d3c437
Add missing calls to 'clean_raw_query' when using LineageRunner ( #8363 )
2022-10-26 11:34:50 +02:00
Teddy
83b048c07c
Fixes #8206 -- Implement data insight refinement for entity report data ( #8351 )
...
* added data insight module to refine and ingest data
* Added json schema for data insight workflow
* Added mixin for data insight
* Added tests for data insight workflow and methods
* Fixed python style
* Fixed python linting
* Fixed unit test
* Added data insight worflow + workflow logging
* Fix python style
* Renamed analytic -> data_insight + added test to make + fixed style
* Fixed java style
* Fixed code smells + python style
* Ignore ES linting for now
* Fixed comments from review
* fix python formatting
* Fixe PipelineType attribute for data insight
2022-10-26 11:18:08 +02:00
Pere Miquel Brull
28401ac9c8
Domo exception management ( #8360 )
2022-10-26 10:33:28 +02:00
Nahuel
1583adee29
Fix lineage to support 'merge into' queries starting with comments ( #8355 )
2022-10-25 10:29:59 -07:00
Teddy
468721fa8a
change sampling method for snflk ( #8336 )
2022-10-24 18:26:00 +02:00
Nahuel
36b12bd6f1
Fix lineage issues with merge_into and copy grants queries ( #8335 )
2022-10-24 17:22:22 +02:00
Pere Miquel Brull
60694bd60f
Disable timeout for windows ( #8331 )
2022-10-24 08:47:00 +02:00
Sriharsha Chintalapani
d5a9cd4bc1
Issue-8315: Parameter 'input' on the metadata restore CLI not working ( #8317 )
2022-10-21 21:49:01 -07:00
Suresh Srinivas
229b56e7b3
Fixes #8236 - Initialize bots from JSON data files ( #8304 )
2022-10-21 08:38:52 -07:00
Onkar Ravgan
0ba3036382
Added DBT col level lineage using queries ( #8176 )
...
* Added DBT col level lineage using queries
* Fixed pylint
* removed too many local vars
* Fixed pylint after rebase
Co-authored-by: Onkar Ravgan <onkarravgan@Onkars-MacBook-Pro.local>
2022-10-21 13:57:52 +02:00
Pere Miquel Brull
d576540cb6
Bump Snowflake version ( #8300 )
2022-10-21 09:41:43 +02:00
Onkar Ravgan
2a85ea4747
Used ES instead of get_by_name ( #8288 )
...
Co-authored-by: Onkar Ravgan <onkarravgan@Onkars-MacBook-Pro.local>
2022-10-20 18:16:39 +05:30
Nahuel
8d8ee3cfdd
Improve error messages and update dashboard YAML example files ( #8286 )
2022-10-20 14:19:58 +02:00
Teddy
030d576df7
Fix test suite bug for redefined quotes ( #8248 )
...
* Fixed bug when running test for same table name across different DB
* Fix python check style
* Fixed linting
2022-10-19 16:30:46 +02:00
Onkar Ravgan
d9b50b5be9
Added project id to DBT cloud config ( #8062 )
...
* Added project id to DBT cloud config
* added field in cloud config source Dbt config
* fix unit test issue
* Fixed pylint
Co-authored-by: Onkar Ravgan <onkarravgan@Onkars-MacBook-Pro.local>
Co-authored-by: Ashish Gupta <ashish@getcollate.io>
2022-10-19 18:59:33 +05:30
NiharDoshi99
e086fb7c25
Add Domo Database Connector ( #8221 )
...
* added domo database connector
* added domo database connector
* changes based on comment
2022-10-19 12:50:58 +02:00
Mayur Singal
0b6e3741b3
Fix Datalake Json Error ( #8246 )
2022-10-19 14:12:23 +05:30
Pere Miquel Brull
26efe40e87
Add metadata main ( #8247 )
2022-10-19 10:02:36 +02:00
Milan Bariya
1565aa7733
FIX: Trino&Presto catalogs as databases ( #8189 )
...
* FIX: Trino&Presto catalogs as databases
* FIX: Trino&Presto catalogs as databases
* Change based on comments
2022-10-18 20:00:17 +05:30
NiharDoshi99
84a89d7181
Added DOMO Pipeline ( #8133 )
2022-10-18 17:52:28 +05:30
Milan Bariya
5b3c877dd1
FIX:connection failed because of having '@' character in uname and pass ( #8172 )
2022-10-17 16:57:55 +05:30
Pere Miquel Brull
d48fd468d4
Tag PATCH + Cleanup of helpers methods ( #8150 )
...
* cleanup
* lint
* Add tag patch
* Fix rename
* Dont kill tests
2022-10-15 14:56:30 +02:00
Nahuel
b69581299f
Fix SonarCloud coverage for Python code ( #8144 )
2022-10-14 15:17:40 +02:00
Mayur Singal
b55a46f4de
Fix #5492 : Fix Trino Comments ( #8113 )
2022-10-14 06:39:31 +02:00
Milan Bariya
e7a3770240
Add: databricks usage and lineage added ( #7386 )
2022-10-14 07:06:28 +05:30
NiharDoshi99
7975f0e6fe
Pylint Fix ( #8134 )
...
* Pylint Fix
* changes as per comment
2022-10-13 14:48:28 +02:00
Nahuel
48905a7f6e
Fix#7532: Allow overriding service connection config when ingesting from CLI ( #8091 )
...
* Allow overriding service connection config when ingesting from CLI
* Rename field in JSON schema
* Address comment
2022-10-13 12:34:03 +02:00
Pere Miquel Brull
615b1a9647
Add Airflow deps installation ( #8131 )
2022-10-13 11:06:27 +02:00
NiharDoshi99
0e44f7d35d
Fixed: Intergrated DOMO Connector APIs ( #7989 )
2022-10-13 10:55:48 +05:30
Ayush Shah
aa9ef323e2
FIx Nonetype Bigquery Taxonomy ( #8110 )
2022-10-12 19:54:13 +05:30
Ayush Shah
58765379a1
Fix Policy Tags from diff project ids ( #8004 )
2022-10-12 15:17:21 +05:30
Onkar Ravgan
92ddda2c15
Fixed DBT snowflake case sensitivty and dbt owner from manifest ( #8052 )
...
* Fixed snowflake case and dbt owner manifest
* Merged main after linting
Co-authored-by: Onkar Ravgan <onkarravgan@Onkars-MacBook-Pro.local>
2022-10-12 14:59:17 +05:30
Milan Bariya
7aaaddf7cc
FIX: Deleted label not appearing for bigquery ( #8090 )
2022-10-12 12:55:12 +05:30
Pere Miquel Brull
4b3ca065c4
Fix #3394 - Pylint fixes and add it to CI ( #8084 )
...
Fix #3394 - Pylint fixes and add it to CI (#8084 )
2022-10-11 17:15:02 +02:00
Teddy
f883863b8a
Fixes #7490 - Split Profiler and TestSuite Interface ( #8032 )
...
* Clean up test suite workflow and interface
* Fixed tests
* Split profiler and testSuite interfaces
* Cleaned up workflows and runners
* Fixed code formatting
* - remove old code
- remove `table` attribute used for testing and used mock instead
* Fixed execution bugs from refactor
* Fixed static type checking for profiler/api/workflow.py
* Fixed linting
* Added __init__ files
2022-10-11 15:57:25 +02:00
Ashish Gupta
8ddab79dc1
UI :- Remove rc-tree and react-table dependencies ( #8049 )
...
* Remove rc-tree and react-table dependencies
* fix unit test issue
* File Formatted
Co-authored-by: Ayush Shah <ayush@getcollate.io>
2022-10-11 15:42:58 +05:30
