394 Commits

Author SHA1 Message Date
Ayush Shah
a5546090e7
Refactored Presto based on schema changes (#3990) 2022-04-09 12:11:43 -07:00
Onkar Ravgan
3402b5f3e2
added password field in vertica config file (#3992)
Co-authored-by: Onkar Ravgan <onkarravgan@Onkars-MacBook-Pro.local>
2022-04-09 12:10:43 -07:00
Mayur Singal
bb90df0e60
Snowflake usage fix (#3991)
* Snowflke Usage Fix

* Snowflke Usage Fix
2022-04-09 21:43:02 +05:30
Onkar Ravgan
c885a7c107
redash-connector-fix and tableu json fixes (#3985)
* Fixed Redash source config

* Review changes

Co-authored-by: Onkar Ravgan <onkarravgan@Onkars-MacBook-Pro.local>
2022-04-09 19:52:42 +05:30
Ayush Shah
d7248cd5b9
Oracle fix (#3984)
* Oracle fix

* Oracle added json refactoring

* Fixed Oracle

* Oracle json modified

* Oracle modified
2022-04-09 19:50:55 +05:30
Mayur Singal
aa6a3fa8c4
Redshift Usage Fixed (#3983)
* Redshift Usage Fixed

* renamed source connection
2022-04-09 18:50:30 +05:30
codingwithabhi
c6bd06944b
glue-connector-fixed (#3980)
* glue-connector-fixed

* code-formatted

* ran-make-core_bump_version_dev

* config-stored-in-variable
2022-04-09 18:28:53 +05:30
Ayush Shah
fbf5861128
Refactored Superset (#3979) 2022-04-09 18:10:00 +05:30
Ayush Shah
3840eb77c0
Refactoring Connectors - Metabase, MariaDB, Looker (#3977)
* Metabase Fix

* Looker, Metabase and Mariadb

* modified metabase
2022-04-09 16:56:12 +05:30
Onkar Ravgan
d5758b2fb2
Fixed Db2 source config (#3978)
Co-authored-by: Onkar Ravgan <onkarravgan@Onkars-MacBook-Pro.local>
2022-04-09 16:30:18 +05:30
Mayur Singal
53e4403ccd
Fixed MSSQL & Clickhouse Usage (#3976) 2022-04-09 13:50:24 +05:30
codingwithabhi
0e0c3459a8
postgres-connector-fixed (#3970) 2022-04-08 13:28:00 -07:00
Ayush Shah
839d152cc3
PowerBI - Schema Refactoring (#3960)
* Added PowerBI refactoring

* Update powerbi.py

* Update powerbi.py

* Modified filters
2022-04-09 00:38:41 +05:30
Mayur Singal
a3ceea6b63
Hive Source Fix (#3919)
* Hive Source Fix

* Added auth option test & unified unit test
2022-04-08 22:29:48 +05:30
Onkar Ravgan
7b26b5ce24
tableau-connector-fix-added (#3946)
* Fixed Tableau source config

* Review changes

Co-authored-by: Onkar Ravgan <onkarravgan@Onkars-MacBook-Pro.local>
2022-04-08 19:23:44 +05:30
codingwithabhi
bb76a2f11b
salesforce-connector-fixed (#3923)
* salesforce-connector-fixed

* salesforce-connection-updated

* ran-make-core_bump_version_dev

* code-formatted

* removed-get_connection_url

* code-formatted

* code-formatted

* code-formatted
2022-04-08 16:08:31 +05:30
Onkar Ravgan
5219bad5e1
singlestore-connector-fix-added (#3937)
* Singlestore config fix
Rebase with main

* Fixed Singlestore source config

* Formating changes

Co-authored-by: Onkar Ravgan <onkarravgan@Onkars-MacBook-Pro.local>
2022-04-08 15:09:10 +05:30
Onkar Ravgan
aae29b1675
Fixed vertica source configs (#3910)
Co-authored-by: Onkar Ravgan <onkarravgan@Onkars-MacBook-Pro.local>
Co-authored-by: Sriharsha Chintalapani <harshach@users.noreply.github.com>
Co-authored-by: Ayush Shah <ayush@getcollate.io>
2022-04-08 14:13:22 +05:30
codingwithabhi
300e8fec55
snowflake-connector-fix (#3885)
* snowflake-connector-fixed

* schema-filter-fixed

* updated-connection_arguments

* ran-py_format

* removed-FQN-computation

* ran-make-core_bump_version_dev-and-py_format

* ranpy_format
2022-04-08 13:28:54 +05:30
Ayush Shah
7c3a6082a6
Refactor - Redshift Connection (#3920) 2022-04-07 08:52:38 -07:00
Mayur Singal
3651efd7f5
Databricks Source Fix (#3917)
Databricks Source Fix (#3917)
2022-04-07 16:40:50 +02:00
Pere Miquel Brull
93525aea0d
Fix #3823 & Fix generate default Enum field (#3909)
* Fix sample data DAG

* Fix callback imports

* Use --set-default-enum-member in generate

* Format

* Add faulty merge hard_delete

* Fix airflow lineage, improve naming and fix lineage tests

* Add mysql url test

* Add mysql url test

* Update CI name

* Fix test ometa endpoint

* Format

* Fix metadata config
2022-04-07 18:22:50 +05:30
Onkar Ravgan
4dce0a061a
Dynamodb source fix (#3882)
Dynamodb source fix (#3882)
2022-04-07 10:15:47 +02:00
Mayur Singal
d7c73362a7
Clickouse Source Fix (#3891) 2022-04-06 10:20:37 -07:00
Mayur Singal
7292695bd3
Sample Data Fix (#3888)
* Sample Data Fix
2022-04-06 18:26:54 +05:30
Mayur Singal
b709a8055e
Fixed MSSQL Source (#3877)
Fixed MSSQL Source (#3877)
2022-04-06 14:21:46 +02:00
Pere Miquel Brull
63533eb388
Fix for connectors based on refactoring of schemas V2 (#3870)
Co-authored-by: Ayush Shah <ayush@getcollate.io>
2022-04-05 18:33:25 -07:00
codingwithabhi
dbfe488a9e
Schema support fix (#3856)
Co-authored-by: ulixius9 <mayursingal9@gmail.com>
2022-04-05 10:51:42 -07:00
Sriharsha Chintalapani
7b3e459eb3
Fix #3659 Refactor Service Connection String to be specific to per service (#3804)
* Fix #3659 Refactor Service Connection String to be specific to per service

* Simplify and centralize Airflow Pipeline info for REST (#3740)

* Remove code

* Modified Configs based on refactoring schema (#3816)

* Clean WorkflowContext


Co-authored-by: pmbrull <peremiquelbrull@gmail.com>
Co-authored-by: Ayush Shah <ayush@getcollate.io>
2022-04-04 12:46:09 -07:00
Sriharsha Chintalapani
b14c8dc2c4
Issue-3685: Variable based separator used for fullyQualifiedName instead of hardcoded . for Python and make the separator to : (#3778)
* Issue-3685: Variable based separator used for fullyQualifiedName instead of hardcoded . for Python and make the sepearator to :

* Fix failing test

* Use colon for run_local_docker validation

* Update tests FQDN

* Update tests FQDN

Co-authored-by: Sachin-chaurasiya <sachinchaurasiyachotey87@gmail.com>
Co-authored-by: pmbrull <peremiquelbrull@gmail.com>
2022-03-31 19:20:27 +05:30
Ayush Shah
351db56687
Added fix for Sample_Usage not being ingested in Local docker (#3650) 2022-03-27 22:38:13 -07:00
Ayush Shah
07266b58f7
Fix: Added DeltaLake Service type (#3639)
* fix-deltalake

* added deltalake.json

* Bumped up version
2022-03-24 18:42:00 +05:30
Ayush Shah
a87ed206c0
Fix Redshift Usage (#3624) 2022-03-23 22:07:25 -07:00
Mayur Singal
a38b08882a
Fix #3566: ingesting sample data with space in name (#3586) 2022-03-22 18:29:03 +05:30
Ayush Shah
5cacd33e2e
Standardized Metabase db_service_name across dashboards (#3458)
* Standardized Metabase db_service_name across dashboards

* Resolved Code Smell

* Update metabase.py
2022-03-22 12:21:54 +05:30
Pere Miquel Brull
130bbb0c5c
Fix #3104 - Remove unused imports with pycln (#3370)
Fix #3104 - Remove unused imports with pycln (#3370)
2022-03-14 06:59:15 +01:00
Ayush Shah
7c84f063e6
Minor Fixes - Ingestion - Datetime format, Looker fix (#3365)
* Minor Fixes - UTC timezone for usage, tag method modification, looker fix

* Modified core version

* Snowflake Usage Result limit and Makefile ignore env fix
2022-03-11 13:31:42 +05:30
Pere Miquel Brull
94d7500216
Fix #3248 & #3251 - Update metrics and column profile (#3262)
Fix #3248 & #3251 - Update metrics and column profile (#3262)
2022-03-08 11:44:39 +01:00
Teddy
6ee31eb21f
Issue-2538: Add Iceberg type for Glue Table + Location Entity (#3210) 2022-03-07 08:27:14 -08:00
Pere Miquel Brull
bd7b91b448
Fix #3112 - col profile safety & sample data (#3142)
Fix #3112 - col profile safety & sample data (#3142)
2022-03-04 13:14:11 +01:00
codingwithabhi
37457dc668
table-name-fail-fix- (#3114) 2022-03-03 13:44:34 -08:00
Mayur Singal
3f144a7370
fix #3077: Fixed validation error in ldap (#3079)
* fix #3077: fixed validation error

* removed print

* changes returntype to OMetaUserProfile
2022-03-03 11:11:07 +05:30
Pere Miquel Brull
71207de362
Fix #2875 - Profiler API Sink (#3011)
Fix #2875 - Profiler API Sink
2022-03-02 16:46:28 +01:00
Alberto Miorin
fe5618c8f1
Fix #3037: metadata --version doesn't work (#3038) 2022-03-01 12:19:36 +01:00
codingwithabhi
06d9329ae3
Atlas connector (#2855)
* Fix #1161: Add Atlas Connector

* Atlast Decimal type handled

* Atlas col_data_type handled

* Atlas columns exception handling implemented

* atlas-services-added-into-single-file

* import-updated

* authentication-fix

* atlas-connector-services-added

* code-smell-removed

* code-smell-removed

* code-smell-removed

* file-exist-check-added

* updated-mapping-json-logic

* pr-comment-changes-completed

* atlas-linegae-added

* atlas-linegae-added

* pr-changes-done

* code-formatted

* bug-resolved

* topic-bug-resolved

Co-authored-by: Sriharsha Chintalapani <harsha@getcollate.io>
Co-authored-by: Ayush Shah <ayush@getcollate.io>
2022-03-01 11:50:14 +05:30
Ayush Shah
568845b65c
Power BI connector (#3019)
* Power BI Dashboard and Tiles added

* Added Powerbi dependency

* Modified Powerbi debug logs

* Bump up _version.py

* Modified Power BI - added failure status, resolved comments
2022-03-01 10:09:35 +05:30
Mayur Singal
c49af971a7
Fix #2984: added azure sso auth (#3002) 2022-02-28 11:44:28 -08:00
Ayush Shah
412d61a875
Fix Okta Authentication and Validation - Ingestion (#2955) 2022-02-26 08:19:36 -08:00
Mayur Singal
e79be68bea
Fix #2937: added clickhouse usage connector (#2987) 2022-02-26 08:18:49 -08:00
Pere Miquel Brull
4d928bab80
Fix #2965 - Additional Properties set to False (#2976) 2022-02-24 08:38:56 -08:00