Pere Miquel Brull
c8f4d496a5
Airflow exception management ( #8410 )
...
* Airflow exception management
* Airflow exception management
2022-10-28 16:11:23 +02:00
Pere Miquel Brull
f834b28198
patch ingestion image ( #8385 )
2022-10-27 15:10:04 +02:00
Onkar Ravgan
c156c344e6
Fixed incorrect const import ( #8380 )
...
Co-authored-by: Onkar Ravgan <onkarravgan@Onkars-MacBook-Pro.local>
2022-10-27 08:54:00 +02:00
Pere Miquel Brull
6d404ccdc1
Domo Pipeline - Use pipeline ID with display name ( #8374 )
...
* Use pipeline ID with display name
* handle id
* lint
* update test for ID
2022-10-26 21:22:26 +02:00
amymareemc
12bc9df0b2
Issue 4886: Add support for Azure Blob ( #8334 )
...
* Issue 4686: Add support for Azure Blob
* ISSUE-4868: make changes as suggested in PR review
* ISSUE-4868: run py_format
* ISSUE-4868: Make changes to enum and formatting
* ISSUE-4868: fix linting issues and update setup.py
2022-10-26 16:14:51 +02:00
Onkar Ravgan
6f1d02ea56
Fixed dbt test case issue ( #8308 )
...
Co-authored-by: Onkar Ravgan <onkarravgan@Onkars-MacBook-Pro.local>
2022-10-26 05:52:23 -07:00
Nahuel
0e66d3c437
Add missing calls to 'clean_raw_query' when using LineageRunner ( #8363 )
2022-10-26 11:34:50 +02:00
Teddy
83b048c07c
Fixes #8206 -- Implement data insight refinement for entity report data ( #8351 )
...
* added data insight module to refine and ingest data
* Added json schema for data insight workflow
* Added mixin for data insight
* Added tests for data insight workflow and methods
* Fixed python style
* Fixed python linting
* Fixed unit test
* Added data insight worflow + workflow logging
* Fix python style
* Renamed analytic -> data_insight + added test to make + fixed style
* Fixed java style
* Fixed code smells + python style
* Ignore ES linting for now
* Fixed comments from review
* fix python formatting
* Fixe PipelineType attribute for data insight
2022-10-26 11:18:08 +02:00
Pere Miquel Brull
28401ac9c8
Domo exception management ( #8360 )
2022-10-26 10:33:28 +02:00
Nahuel
1583adee29
Fix lineage to support 'merge into' queries starting with comments ( #8355 )
2022-10-25 10:29:59 -07:00
Teddy
468721fa8a
change sampling method for snflk ( #8336 )
2022-10-24 18:26:00 +02:00
Nahuel
36b12bd6f1
Fix lineage issues with merge_into and copy grants queries ( #8335 )
2022-10-24 17:22:22 +02:00
Pere Miquel Brull
60694bd60f
Disable timeout for windows ( #8331 )
2022-10-24 08:47:00 +02:00
Sriharsha Chintalapani
d5a9cd4bc1
Issue-8315: Parameter 'input' on the metadata restore CLI not working ( #8317 )
2022-10-21 21:49:01 -07:00
Suresh Srinivas
229b56e7b3
Fixes #8236 - Initialize bots from JSON data files ( #8304 )
2022-10-21 08:38:52 -07:00
Onkar Ravgan
0ba3036382
Added DBT col level lineage using queries ( #8176 )
...
* Added DBT col level lineage using queries
* Fixed pylint
* removed too many local vars
* Fixed pylint after rebase
Co-authored-by: Onkar Ravgan <onkarravgan@Onkars-MacBook-Pro.local>
2022-10-21 13:57:52 +02:00
Pere Miquel Brull
d576540cb6
Bump Snowflake version ( #8300 )
2022-10-21 09:41:43 +02:00
Onkar Ravgan
2a85ea4747
Used ES instead of get_by_name ( #8288 )
...
Co-authored-by: Onkar Ravgan <onkarravgan@Onkars-MacBook-Pro.local>
2022-10-20 18:16:39 +05:30
Nahuel
8d8ee3cfdd
Improve error messages and update dashboard YAML example files ( #8286 )
2022-10-20 14:19:58 +02:00
Teddy
030d576df7
Fix test suite bug for redefined quotes ( #8248 )
...
* Fixed bug when running test for same table name across different DB
* Fix python check style
* Fixed linting
2022-10-19 16:30:46 +02:00
Onkar Ravgan
d9b50b5be9
Added project id to DBT cloud config ( #8062 )
...
* Added project id to DBT cloud config
* added field in cloud config source Dbt config
* fix unit test issue
* Fixed pylint
Co-authored-by: Onkar Ravgan <onkarravgan@Onkars-MacBook-Pro.local>
Co-authored-by: Ashish Gupta <ashish@getcollate.io>
2022-10-19 18:59:33 +05:30
NiharDoshi99
e086fb7c25
Add Domo Database Connector ( #8221 )
...
* added domo database connector
* added domo database connector
* changes based on comment
2022-10-19 12:50:58 +02:00
Mayur Singal
0b6e3741b3
Fix Datalake Json Error ( #8246 )
2022-10-19 14:12:23 +05:30
Pere Miquel Brull
26efe40e87
Add metadata main ( #8247 )
2022-10-19 10:02:36 +02:00
Milan Bariya
1565aa7733
FIX: Trino&Presto catalogs as databases ( #8189 )
...
* FIX: Trino&Presto catalogs as databases
* FIX: Trino&Presto catalogs as databases
* Change based on comments
2022-10-18 20:00:17 +05:30
NiharDoshi99
84a89d7181
Added DOMO Pipeline ( #8133 )
2022-10-18 17:52:28 +05:30
Milan Bariya
5b3c877dd1
FIX:connection failed because of having '@' character in uname and pass ( #8172 )
2022-10-17 16:57:55 +05:30
Pere Miquel Brull
d48fd468d4
Tag PATCH + Cleanup of helpers methods ( #8150 )
...
* cleanup
* lint
* Add tag patch
* Fix rename
* Dont kill tests
2022-10-15 14:56:30 +02:00
Nahuel
b69581299f
Fix SonarCloud coverage for Python code ( #8144 )
2022-10-14 15:17:40 +02:00
Mayur Singal
b55a46f4de
Fix #5492 : Fix Trino Comments ( #8113 )
2022-10-14 06:39:31 +02:00
Milan Bariya
e7a3770240
Add: databricks usage and lineage added ( #7386 )
2022-10-14 07:06:28 +05:30
NiharDoshi99
7975f0e6fe
Pylint Fix ( #8134 )
...
* Pylint Fix
* changes as per comment
2022-10-13 14:48:28 +02:00
Nahuel
48905a7f6e
Fix#7532: Allow overriding service connection config when ingesting from CLI ( #8091 )
...
* Allow overriding service connection config when ingesting from CLI
* Rename field in JSON schema
* Address comment
2022-10-13 12:34:03 +02:00
Pere Miquel Brull
615b1a9647
Add Airflow deps installation ( #8131 )
2022-10-13 11:06:27 +02:00
NiharDoshi99
0e44f7d35d
Fixed: Intergrated DOMO Connector APIs ( #7989 )
2022-10-13 10:55:48 +05:30
Ayush Shah
aa9ef323e2
FIx Nonetype Bigquery Taxonomy ( #8110 )
2022-10-12 19:54:13 +05:30
Ayush Shah
58765379a1
Fix Policy Tags from diff project ids ( #8004 )
2022-10-12 15:17:21 +05:30
Onkar Ravgan
92ddda2c15
Fixed DBT snowflake case sensitivty and dbt owner from manifest ( #8052 )
...
* Fixed snowflake case and dbt owner manifest
* Merged main after linting
Co-authored-by: Onkar Ravgan <onkarravgan@Onkars-MacBook-Pro.local>
2022-10-12 14:59:17 +05:30
Milan Bariya
7aaaddf7cc
FIX: Deleted label not appearing for bigquery ( #8090 )
2022-10-12 12:55:12 +05:30
Pere Miquel Brull
4b3ca065c4
Fix #3394 - Pylint fixes and add it to CI ( #8084 )
...
Fix #3394 - Pylint fixes and add it to CI (#8084 )
2022-10-11 17:15:02 +02:00
Teddy
f883863b8a
Fixes #7490 - Split Profiler and TestSuite Interface ( #8032 )
...
* Clean up test suite workflow and interface
* Fixed tests
* Split profiler and testSuite interfaces
* Cleaned up workflows and runners
* Fixed code formatting
* - remove old code
- remove `table` attribute used for testing and used mock instead
* Fixed execution bugs from refactor
* Fixed static type checking for profiler/api/workflow.py
* Fixed linting
* Added __init__ files
2022-10-11 15:57:25 +02:00
Ashish Gupta
8ddab79dc1
UI :- Remove rc-tree and react-table dependencies ( #8049 )
...
* Remove rc-tree and react-table dependencies
* fix unit test issue
* File Formatted
Co-authored-by: Ayush Shah <ayush@getcollate.io>
2022-10-11 15:42:58 +05:30
Teddy
3b7f576d04
Fixed linting for Profiler ( #7922 )
...
* - Fixed linting
- Added logic to skip partition check when engine is not BQ
- Added ingestion partition logic to testSuite
* Fixed python formating
* Fixed test for BQ partition
2022-10-11 09:36:36 +02:00
Mayur Singal
22ac150d7b
Database Source Lint ( #8034 )
2022-10-11 13:05:08 +05:30
Nahuel
806dcea0de
Fix Superset REST client requests ( #8058 )
2022-10-11 08:23:26 +02:00
Pere Miquel Brull
339abc5bf3
Prepare Ingestion Base Docker image ( #8065 )
...
Prepare Ingestion Base Docker image (#8065 )
2022-10-11 07:50:49 +02:00
Teddy
3c093f65fc
Fixes test suite pylint ( #7937 )
...
* Fixed linting for testSuite
* fixed python format
* Fixed conflict
2022-10-11 06:55:14 +02:00
Teddy
d0984c5a43
Fixes lineage linting ( #7956 )
...
* Fixed pylint
* Fixed python formating
2022-10-11 06:55:08 +02:00
Mayur Singal
a2894f7990
Dashboard Source Lint ( #7987 )
2022-10-11 06:50:55 +02:00
Pere Miquel Brull
f031293af0
Fix Pylint ingestion/bulksink and ingestion/stage ( #8030 )
...
* Pylint ingestion bulksink
* Pylint stage
* Remove test
* Remove stage
2022-10-10 14:06:43 +02:00
