171 Commits

Author SHA1 Message Date
Ayush Shah
2d7d89754c
Remove Click and Add ArgParse (#8182) 2022-10-31 18:12:26 +05:30
amymareemc
12bc9df0b2
Issue 4886: Add support for Azure Blob (#8334)
* Issue 4686: Add support for Azure Blob

* ISSUE-4868: make changes as suggested in PR review

* ISSUE-4868: run py_format

* ISSUE-4868: Make changes to enum and formatting

* ISSUE-4868: fix linting issues and update setup.py
2022-10-26 16:14:51 +02:00
Nahuel
36b12bd6f1
Fix lineage issues with merge_into and copy grants queries (#8335) 2022-10-24 17:22:22 +02:00
Pere Miquel Brull
d576540cb6
Bump Snowflake version (#8300) 2022-10-21 09:41:43 +02:00
NiharDoshi99
0e44f7d35d
Fixed: Intergrated DOMO Connector APIs (#7989) 2022-10-13 10:55:48 +05:30
Nahuel
5c499d2a7a
Add CLI E2E tests for MySQL (#8041)
* Add CLI E2E tests for MySQL

* Fix setup.py and pylint

* Add missing doc and update code after pylint refactor
2022-10-10 11:36:20 +02:00
Abhishek Pandey
566602373f
datalake-gcs-performance-improved (#7609) 2022-10-04 09:52:10 +05:30
NiharDoshi99
8adcf2ee3d
Fixed: Dagster to work with its API (#7579) 2022-09-23 17:46:40 +05:30
Mayur Singal
a439161d8b
#7316: Bump sqllineage version to 1.3.6 (#7598)
Co-authored-by: Mayur <mayur@Mayurs-MacBook-Pro.local>
2022-09-21 10:14:47 +05:30
Mayur Singal
947cb4e99e
Fix #7316: Fix Hive View error for older version (#7592) 2022-09-21 07:50:17 +05:30
Nahuel
2a6c6134f4
Fix#7272: Improve logging when initializing workflow from CLI (#7522)
* Improve logging when initializing workflow from CLI

* Fix broken tests
2022-09-19 08:00:00 -07:00
Cristian Calugaru
a326d3bcc0
lib upgrades (#7536)
* lib upgrades

* black reformatting

* downgraded datamode-core-generator to 0.13.0 and pydantic to 1.9.0
2022-09-18 16:51:49 -07:00
Milan Bariya
591517a487
Fix: Align pre-commit isort (#7380) 2022-09-14 15:10:06 +02:00
Teddy
d171e2f100
Removed typing_extension dependency (#7406) 2022-09-13 15:10:11 +02:00
Akash Jain
f2fc45ea41
feat: prepare-for-next-release-0-13-0 (#7348) 2022-09-09 01:25:41 +05:30
Pere Miquel Brull
613a329f40
Fix #7089 - Add Redpanda connector (#7092)
Fix #7089 - Add Redpanda connector (#7092)
2022-09-01 06:39:27 +02:00
Pere Miquel Brull
6cebf37b6c
Fix #6906 - Add Nifi connector (#6956)
* Add Nifi connector

* Mock token

* Format

* pass verify param
2022-08-26 21:50:01 +02:00
Milan Bariya
994b769d25
Databricks Connection - User & Password clean (#6866)
* Databricks Connection - User & Password clean

* Fix: Python checkstyle failed

* Fix: update the migration scripts
2022-08-23 14:36:58 +02:00
Abhishek Pandey
a6a7662517
dagster-connector-added (#6513)
* dagster-connector-added

* code-formatted

* dagster-comments-removed

* dagster-comments-removed

* dagster-unittest-added

* code-formatted-pr-comments-resolved

* improved-code-quality

* increased-py-test-time-out

* improved-dagster-tests

* improved-dagster-tests

* reverted-pytests-timeout

* dagster-pytest-improved

* added-schema-in-omdcore

* updated-schema-in-omd-core

* ui-schema-updated-omd-core

* updated-dagster-schema

* dagter-schema-test-updated
2022-08-13 15:18:14 +05:30
Milan Bariya
c38ab8c8aa
Support for AWS-delegated credentials for Elasticsearch (#6644)
* Support for AWS-delegated credentials for Elasticsearch

* FIX: Based on comments

* FIX: Based on comments

* FIX: Based on comments
2022-08-09 12:36:16 +05:30
Mayur Singal
5e1b124d57
Fix #6530 & Fix #4975: Oracle Connection Enhancements (#6579)
* Fix #6530 & Fix #4975: Oracle Connection Enhancements

* updated migrations & docs
2022-08-05 10:28:04 +05:30
Sriharsha Chintalapani
1a42428e42
Add time series extention (#6416)
Co-authored-by: Vivek Ratnavel Subramanian <vivekratnavel90@gmail.com>
Co-authored-by: Teddy <teddy.crepineau@gmail.com>
Co-authored-by: Shailesh Parmar <shailesh.parmar.webdev@gmail.com>
2022-08-04 07:22:47 -07:00
Pere Miquel Brull
b7eb41a560
Fix #5840 - Upgrade Airflow container to 2.3.3 (#6362)
Fix #5840 - Upgrade Airflow container to 2.3.3 (#6362)
2022-07-28 14:46:25 +02:00
Pere Miquel Brull
7560635114
Fix #6280 - Bump DeltaLake version, tests and docs (#6307)
Fix #6280 - Bump DeltaLake version, tests and docs (#6307)
2022-07-24 18:49:15 +02:00
Nahuel
0602e8c894
Fix#5924: Implement secret manager for Airflow REST Plugin (#6128)
Fix#5924: Implement secret manager for Airflow REST Plugin (#6128)
2022-07-19 14:51:44 +02:00
Pere Miquel Brull
479a8de486
Fix #5885 - Provider loading fails for airflow <2.3 (#5927)
Fix #5885 - Provider loading fails for airflow <2.3 (#5927)
2022-07-14 15:07:39 +02:00
Vj-L
011651f078
"Updated the tags with latest tag" (#5962)
Co-authored-by: “Vijay” <“vijay.l@deuexsolutions.com”>
2022-07-08 16:43:39 +05:30
Pere Miquel Brull
89a026b022
Fix #5688 - MlFlow deployment fails from UI (#5691)
* Fix mlflow from UI

* format
2022-06-28 14:58:38 +02:00
Sriharsha Chintalapani
710e782f33
Fix #5455: Ingestion from a kafka topic fails when sample data is enabled (#5536)
Co-authored-by: ulixius9 <mayursingal9@gmail.com>
2022-06-24 20:39:41 -07:00
Mayur Singal
9fbe07d2d0
Fix #5544: Downgrading Kafka Version (#5545) 2022-06-21 13:22:04 -07:00
Pere Miquel Brull
0ecc9f0da6
Fix #5459 - Remove sql-metadata in favor of sqllineage (#5494)
Fix #5459 - Remove sql-metadata in favor of sqllineage (#5494)
2022-06-21 18:02:50 +02:00
Abhishek Pandey
e8975aac01
datalake-csv-files-ingestion-added (#5343)
datalake-csv-files-ingestion-added (#5343)
2022-06-15 08:57:21 +02:00
Pere Miquel Brull
d9d30b2cba
Fix #5416 - Revisit Looker Test Connection (#5422)
Fix #5416 - Revisit Looker Test Connection (#5422)
2022-06-13 08:07:04 +02:00
Sriharsha Chintalapani
65330f24ef
Fix #5305: Add simple webhook server to metadata command to test metadata events (#5306) 2022-06-06 10:07:09 +05:30
Mayur Singal
b3428771a3
Fix #4767: Refactor Usage & Lineage (#5190)
Fix #4767: Refactor Usage & Lineage (#5190)
2022-06-03 10:12:28 +02:00
Onkar Ravgan
4671ca00b0
Refactored PowerBi Connector (#5107)
Refactored PowerBi Connector (#5107)
2022-06-01 10:36:12 +02:00
Teddy
bbe5cfa9e7
[ISSUE-3450] openmetadata-ingestion great-expectations submodule (#4752)
[ISSUE-3450] openmetadata-ingestion great-expectations submodule (#4752)
2022-05-26 15:16:03 +02:00
Pere Miquel Brull
8e121fb306
Fix #4096 - PipelineService JSON refactor & Airflow metadata source connector (#5125)
Fix #4096 - PipelineService JSON refactor & Airflow metadata source connector (#5125)
2022-05-25 08:35:16 +02:00
Pere Miquel Brull
cd35447792
Fix #4688 - Python FQN with ANTRL & ES (#5073)
Fix #4688 - Python FQN with ANTRL & ES (#5073)
2022-05-23 09:51:34 +02:00
Pere Miquel Brull
a1952e76b4
Fix pydantic to 1.8.2 (#5045) 2022-05-19 16:38:10 +02:00
Ayush Shah
b6fc33cda2
Fix compatibility issue with get_args (#5012) 2022-05-18 10:55:39 +05:30
Ayush Shah
93c32ad801
Removed Ingestion Core dependency (#5006) 2022-05-18 00:01:20 +05:30
Ayush Shah
8cc91c3405
Modified Ingestion to support 3.6 and later (#5003) 2022-05-17 21:38:57 +05:30
Milan Bariya
0acf88e1ba
ISSUE-1072: Add Apache Pinot support (#4649)
* ISSUE-1072: Add Apache Pinot support

* ISSUE-1072: Add Apache Pinot support

* Rename pinotdbConnection.json to pinotDBConnection.json
2022-05-11 11:13:28 +02:00
Ayush Shah
c94de59a40
Missing pymssql dependency (#4841) 2022-05-10 19:28:16 +05:30
Sriharsha Chintalapani
34858f3b32
Topics: Add Sample data (#4787)
* Topics: Add Sample data

* Topics: Add Sample data

* Topics: Add Sample data

* Topics: Add Sample data

* Topics: Add Sample data
2022-05-09 12:50:54 +02:00
Onkar Ravgan
6a5ffb0626
added google cloud storage dependency (#4651)
Co-authored-by: Onkar Ravgan <onkarravgan@Onkars-MacBook-Pro.local>
2022-05-03 15:13:46 +05:30
Ayush Shah
88cf0930e2
Fix Dependency issue (#4523) 2022-04-27 14:54:47 +05:30
Akash Jain
55e1be9ca4
feat: Prepare 0.11.0-snapshot version changes (#4505)
* updated version to 0.11.0-SNAPSHOT

* updated version to 0.11.0.dev* for ingestion

* docker version updates for metadata docker cli

* OM Server Env Variables from #4197 #4261 #4473
2022-04-27 00:41:17 +05:30
Pere Miquel Brull
bd150d8124
Fix #4457 - BigQuery requirements to handle keys (#4464)
* Add defaults

* Add crypto req for bigquery

* Crypto is in base
2022-04-25 11:54:45 +02:00