27 Commits

Author SHA1 Message Date
Mayur Singal
0fafbf70ba
Support postgres multiple DB ingestion for user with no access (#10207) 2023-02-23 15:42:40 +05:30
Pere Miquel Brull
84348d4748
Fix #8866 - bump datamodel-codegen (#9623)
* Fix #8866 - bump datamodel-codegen

* Update connection options and arguments structure

* Add builders test

* Format

* Allow Any values in componentConfig

Co-authored-by: Sriharsha Chintalapani <harshach@users.noreply.github.com>
2023-01-09 13:20:32 +01:00
Pere Miquel Brull
7f21a7bced
Fix #8088 - Restructure source connections & clients (#9545) 2023-01-02 13:52:27 +01:00
Nahuel
819001182f
Fix#9251: DB2 connection config and ingestion update (#9322)
* DB2 connection config and ingestion update

* Update ingestion/src/metadata/ingestion/source/database/common_db_source.py

Co-authored-by: Ayush Shah <ayush@getcollate.io>

* Update ingestion/src/metadata/ingestion/source/database/common_db_source.py

Co-authored-by: Ayush Shah <ayush@getcollate.io>

* Update bootstrap/sql/com.mysql.cj.jdbc.Driver/v007__create_db_connection_info.sql

Co-authored-by: Ayush Shah <ayush@getcollate.io>
2022-12-16 07:43:18 +01:00
Milan Bariya
27997b2f77
Fix: Revert Athena tests and types change (#8909) 2022-11-21 12:35:23 +01:00
Pere Miquel Brull
34ba9d95c5
Ingestion Pipeline deployed, Athena tests and pydantic extras (#8682)
* Always run python tests

* Fix athena tests and types

* Update deployed prop in IngestionPipeline

* Fix #8554

* Format

* Use true as default deployed migration

* Remove repeated req

* Pydantic wiggle room
2022-11-13 11:59:43 +01:00
Milan Bariya
4d16be2608
Fix: Hive connection issue (#8583)
* Fix: Hive connection issue

* Change based on comments
2022-11-08 16:22:37 +01:00
Milan Bariya
1565aa7733
FIX: Trino&Presto catalogs as databases (#8189)
* FIX: Trino&Presto catalogs as databases

* FIX: Trino&Presto catalogs as databases

* Change based on comments
2022-10-18 20:00:17 +05:30
Milan Bariya
5b3c877dd1
FIX:connection failed because of having '@' character in uname and pass (#8172) 2022-10-17 16:57:55 +05:30
Milan Bariya
cd43f1fdcf
Fix: connector for hive has double dash (#7953) 2022-10-05 12:01:13 +02:00
NiharDoshi99
f0f0476396
Added http & https scheme options in Hive connector (#6899)
* Added other scheme options in Hive connector

* Added other scheme options in Hive connector
2022-08-24 18:30:30 +05:30
Mayur Singal
7c004a6785
Fix #6823: Fix hive attribute error (#6824)
* Fix #6823: Fix hive attribute error

* Empty commit to start test
2022-08-19 14:22:54 +02:00
Mayur Singal
5e1b124d57
Fix #6530 & Fix #4975: Oracle Connection Enhancements (#6579)
* Fix #6530 & Fix #4975: Oracle Connection Enhancements

* updated migrations & docs
2022-08-05 10:28:04 +05:30
Nahuel
a878aa911c
Fix#6212: Retrieve connection params from secret manager in CLI commands (#6441)
* Retrieve connection params from secret manager for database connectors

* Retrieve connection params from secret manager for all services except database connectors

* Stop retrieving connection from SM in Airflow rest plugin

* Retrieve connection params from secret manager for dashboard services

* Retrieve connection params when initializing Workflow/ProfilerWorkflow objects

* Align services topologies + comment changes in topology runner

* Address SonarCloud bug detected

* Update database service topology

* Address PR comments

* Address PR comments

* Address PR comments
2022-08-02 09:13:46 +02:00
Mayur Singal
ebc9a24ee0
Connection options fix (#5971)
* Connection Options Fix

* Fixed Condition
2022-07-08 17:44:18 +02:00
Pere Miquel Brull
02fece727b
Fix #5307 - Define a better topology for Ingestion Sources (#5366)
Fix #5307 - Define a better topology for Ingestion Sources (#5366)
2022-06-13 12:17:54 +02:00
Milan Bariya
ec1aca926a
Fix #5210: Review database field for connectors (#5225)
* Fix #5210: Review database field for connectors
2022-06-06 10:48:23 +05:30
Abhishek Pandey
12e8a1fcf6
required-fields-updated-in-snowflake-and-athena (#5143)
required-fields-updated-in-snowflake-and-athena (#5143)
2022-05-30 14:57:26 +02:00
Abhishek Pandey
8fd69e7eb8
source-connection-test-updated (#5126) 2022-05-25 07:36:00 +02:00
codingwithabhi
da92d07c78
source-connection-unitest-added (#4916) 2022-05-13 13:48:04 +05:30
Milan Bariya
d1f21911f5
Add: Unit Test source for multiple conn (#4845)
Add: Unit Test source for multiple conn (#4845)
2022-05-12 14:31:09 +02:00
Milan Bariya
0acf88e1ba
ISSUE-1072: Add Apache Pinot support (#4649)
* ISSUE-1072: Add Apache Pinot support

* ISSUE-1072: Add Apache Pinot support

* Rename pinotdbConnection.json to pinotDBConnection.json
2022-05-11 11:13:28 +02:00
Mayur Singal
7e684a91eb
Fixed #4769: Trino Connection Argument Fix (#4794)
* Fixed #4769: Trino Connection Argument Fix

* Added tests

* Imporved test with proxy and without conn args
2022-05-09 12:46:03 +02:00
Mayur Singal
355e6dc6b0
Fixed Druid Source Connector (#4476) 2022-04-25 06:46:35 -07:00
Onkar Ravgan
0536cdedcf
Fixes for vertica password issue and added connection url test (#4323)
* rebase with main

* optimized password logic and added tests

Co-authored-by: Onkar Ravgan <onkarravgan@Onkars-MacBook-Pro.local>
2022-04-22 07:38:35 +02:00
Mayur Singal
c48bc18065
Fix Hive & DB2 (#4147) 2022-04-14 10:27:05 -07:00
Mayur Singal
a3ceea6b63
Hive Source Fix (#3919)
* Hive Source Fix

* Added auth option test & unified unit test
2022-04-08 22:29:48 +05:30