yujunjun/OpenMetadata
1
0
Fork 0
mirror of https://github.com/open-metadata/OpenMetadata.git synced 2025-10-31 18:48:35 +00:00
Code Issues Packages Projects Releases Wiki Activity
3,865 Commits 873 Branches 177 Tags
Commit Graph

155 Commits

Author SHA1 Message Date
Pere Miquel Brull
6cebf37b6c
Fix #6906 - Add Nifi connector (#6956) 
* Add Nifi connector

* Mock token

* Format

* pass verify param
 2022-08-26 21:50:01 +02:00
Milan Bariya
994b769d25
Databricks Connection - User & Password clean (#6866) 
* Databricks Connection - User & Password clean

* Fix: Python checkstyle failed

* Fix: update the migration scripts
 2022-08-23 14:36:58 +02:00
Abhishek Pandey
a6a7662517
dagster-connector-added (#6513) 
* dagster-connector-added

* code-formatted

* dagster-comments-removed

* dagster-comments-removed

* dagster-unittest-added

* code-formatted-pr-comments-resolved

* improved-code-quality

* increased-py-test-time-out

* improved-dagster-tests

* improved-dagster-tests

* reverted-pytests-timeout

* dagster-pytest-improved

* added-schema-in-omdcore

* updated-schema-in-omd-core

* ui-schema-updated-omd-core

* updated-dagster-schema

* dagter-schema-test-updated
 2022-08-13 15:18:14 +05:30
Milan Bariya
c38ab8c8aa
Support for AWS-delegated credentials for Elasticsearch (#6644) 
* Support for AWS-delegated credentials for Elasticsearch

* FIX: Based on comments

* FIX: Based on comments

* FIX: Based on comments
 2022-08-09 12:36:16 +05:30
Mayur Singal
5e1b124d57
Fix #6530 & Fix #4975: Oracle Connection Enhancements (#6579) 
* Fix #6530 & Fix #4975: Oracle Connection Enhancements

* updated migrations & docs
 2022-08-05 10:28:04 +05:30
Sriharsha Chintalapani
1a42428e42
Add time series extention (#6416) 
Co-authored-by: Vivek Ratnavel Subramanian <vivekratnavel90@gmail.com>
Co-authored-by: Teddy <teddy.crepineau@gmail.com>
Co-authored-by: Shailesh Parmar <shailesh.parmar.webdev@gmail.com>
 2022-08-04 07:22:47 -07:00
Pere Miquel Brull
b7eb41a560
Fix #5840 - Upgrade Airflow container to 2.3.3 (#6362) 
Fix #5840 - Upgrade Airflow container to 2.3.3 (#6362)
 2022-07-28 14:46:25 +02:00
Pere Miquel Brull
7560635114
Fix #6280 - Bump DeltaLake version, tests and docs (#6307) 
Fix #6280 - Bump DeltaLake version, tests and docs (#6307)
 2022-07-24 18:49:15 +02:00
Nahuel
0602e8c894
Fix#5924: Implement secret manager for Airflow REST Plugin (#6128) 
Fix#5924: Implement secret manager for Airflow REST Plugin (#6128)
 2022-07-19 14:51:44 +02:00
Pere Miquel Brull
479a8de486
Fix #5885 - Provider loading fails for airflow <2.3 (#5927) 
Fix #5885 - Provider loading fails for airflow <2.3 (#5927)
 2022-07-14 15:07:39 +02:00
Vj-L
011651f078
"Updated the tags with latest tag" (#5962) 
Co-authored-by: “Vijay” <“vijay.l@deuexsolutions.com”>
 2022-07-08 16:43:39 +05:30
Pere Miquel Brull
89a026b022
Fix #5688 - MlFlow deployment fails from UI (#5691) 
* Fix mlflow from UI

* format
 2022-06-28 14:58:38 +02:00
Sriharsha Chintalapani
710e782f33
Fix #5455: Ingestion from a kafka topic fails when sample data is enabled (#5536) 
Co-authored-by: ulixius9 <mayursingal9@gmail.com>
 2022-06-24 20:39:41 -07:00
Mayur Singal
9fbe07d2d0
Fix #5544: Downgrading Kafka Version (#5545) 2022-06-21 13:22:04 -07:00
Pere Miquel Brull
0ecc9f0da6
Fix #5459 - Remove sql-metadata in favor of sqllineage (#5494) 
Fix #5459 - Remove sql-metadata in favor of sqllineage (#5494)
 2022-06-21 18:02:50 +02:00
Abhishek Pandey
e8975aac01
datalake-csv-files-ingestion-added (#5343) 
datalake-csv-files-ingestion-added (#5343)
 2022-06-15 08:57:21 +02:00
Pere Miquel Brull
d9d30b2cba
Fix #5416 - Revisit Looker Test Connection (#5422) 
Fix #5416 - Revisit Looker Test Connection (#5422)
 2022-06-13 08:07:04 +02:00
Sriharsha Chintalapani
65330f24ef
Fix #5305: Add simple webhook server to metadata command to test metadata events (#5306) 2022-06-06 10:07:09 +05:30
Mayur Singal
b3428771a3
Fix #4767: Refactor Usage & Lineage (#5190) 
Fix #4767: Refactor Usage & Lineage (#5190)
 2022-06-03 10:12:28 +02:00
Onkar Ravgan
4671ca00b0
Refactored PowerBi Connector (#5107) 
Refactored PowerBi Connector (#5107)
 2022-06-01 10:36:12 +02:00
Teddy
bbe5cfa9e7
[ISSUE-3450] openmetadata-ingestion great-expectations submodule (#4752) 
[ISSUE-3450] openmetadata-ingestion great-expectations submodule (#4752)
 2022-05-26 15:16:03 +02:00
Pere Miquel Brull
8e121fb306
Fix #4096 - PipelineService JSON refactor & Airflow metadata source connector (#5125) 
Fix #4096 - PipelineService JSON refactor & Airflow metadata source connector (#5125)
 2022-05-25 08:35:16 +02:00
Pere Miquel Brull
cd35447792
Fix #4688 - Python FQN with ANTRL & ES (#5073) 
Fix #4688 - Python FQN with ANTRL & ES (#5073)
 2022-05-23 09:51:34 +02:00
Pere Miquel Brull
a1952e76b4
Fix pydantic to 1.8.2 (#5045) 2022-05-19 16:38:10 +02:00
Ayush Shah
b6fc33cda2
Fix compatibility issue with get_args (#5012) 2022-05-18 10:55:39 +05:30
Ayush Shah
93c32ad801
Removed Ingestion Core dependency (#5006) 2022-05-18 00:01:20 +05:30
Ayush Shah
8cc91c3405
Modified Ingestion to support 3.6 and later (#5003) 2022-05-17 21:38:57 +05:30
Milan Bariya
0acf88e1ba
ISSUE-1072: Add Apache Pinot support (#4649) 
* ISSUE-1072: Add Apache Pinot support

* ISSUE-1072: Add Apache Pinot support

* Rename pinotdbConnection.json to pinotDBConnection.json
 2022-05-11 11:13:28 +02:00
Ayush Shah
c94de59a40
Missing pymssql dependency (#4841) 2022-05-10 19:28:16 +05:30
Sriharsha Chintalapani
34858f3b32
Topics: Add Sample data (#4787) 
* Topics: Add Sample data

* Topics: Add Sample data

* Topics: Add Sample data

* Topics: Add Sample data

* Topics: Add Sample data
 2022-05-09 12:50:54 +02:00
Onkar Ravgan
6a5ffb0626
added google cloud storage dependency (#4651) 
Co-authored-by: Onkar Ravgan <onkarravgan@Onkars-MacBook-Pro.local>
 2022-05-03 15:13:46 +05:30
Ayush Shah
88cf0930e2
Fix Dependency issue (#4523) 2022-04-27 14:54:47 +05:30
Akash Jain
55e1be9ca4
feat: Prepare 0.11.0-snapshot version changes (#4505) 
* updated version to 0.11.0-SNAPSHOT

* updated version to 0.11.0.dev* for ingestion

* docker version updates for metadata docker cli

* OM Server Env Variables from #4197 #4261 #4473
 2022-04-27 00:41:17 +05:30
Pere Miquel Brull
bd150d8124
Fix #4457 - BigQuery requirements to handle keys (#4464) 
* Add defaults

* Add crypto req for bigquery

* Crypto is in base
 2022-04-25 11:54:45 +02:00
Onkar Ravgan
c4aa07858d
ISSUE-2925: Added support to get dbt files via s3, gcs and http sources (#3736) 2022-04-19 19:36:24 +05:30
Pere Miquel Brull
91af412cbf
Remove airflow plugin (#4217) 2022-04-19 07:54:27 +02:00
Ayush Shah
4f5c5a9e23
Ingestion - fix pytest workflow errors and modify airflow pipeline (#4178) 2022-04-18 11:36:21 +05:30
Ayush Shah
6cea695e23
Added ES mixin - supports Lineage creation (#4163) 2022-04-15 23:16:19 -07:00
Ayush Shah
1f3667b46f
Fix Python test (#4095) 2022-04-13 21:03:33 +05:30
Mayur Singal
726da97dd8
Fix #3654: Fixed TypeError in Deltalake (#3710) 
* Fix #3654: fixed minor bugs

* Fixed table ingestion issues

* Added sample script for deltalake

* Added Hive Metastore support

* Added support for local metastore

* removed code smell

* Resolved review comments

* fixed display data type logic

* Fixed Code Smell and Resolved conflicts

* Fixed Delta lake source

* removed set spark

* Updated prepare method

* id fix

* Metatore exception added
 2022-04-11 10:45:59 +05:30
dvecerdea
23d68b24d9
Replace sqlalchemy-trino with trino[sqlalchemy] (#3800) 2022-04-01 12:12:03 -07:00
Pere Miquel Brull
3b7b65d46c
Upper bound click req (#3724) 2022-03-29 11:28:41 +05:30
Pere Miquel Brull
1c21abebdd
Fix #3645 - Revisit lineage for Airflow 1.10.15 (#3696) 
Fix #3645 - Revisit lineage for Airflow 1.10.15 (#3696)
 2022-03-28 08:33:02 +02:00
Mayur Singal
3aa8755a7f
Fix #3465: Added trino version (#3466) 2022-03-16 09:00:08 -07:00
Ayush Shah
28a1918ed8
Fixed Looker - Dashboard and Dashboard Elements (#3441) 
* Looker fix

* Update looker.py
 2022-03-16 11:52:29 +05:30
Onkar Ravgan
ad04136847
Fix #3095: Added support for private key (#3408) 
* ISSUE-3095: Add support for private key in snowflake

rebase main branch

* Fix #3095: Added support for private key

* Fix #3095: Added support for private key and review changes

* Fix #3095: Added support for private key and review changes

* changed direct assignment of dictionary

Co-authored-by: Onkar Ravgan <onkarravgan@Onkars-MacBook-Pro.local>
 2022-03-15 18:19:02 +05:30
Pere Miquel Brull
130bbb0c5c
Fix #3104 - Remove unused imports with pycln (#3370) 
Fix #3104 - Remove unused imports with pycln (#3370)
 2022-03-14 06:59:15 +01:00
Ayush Shah
7c84f063e6
Minor Fixes - Ingestion - Datetime format, Looker fix (#3365) 
* Minor Fixes - UTC timezone for usage, tag method modification, looker fix

* Modified core version

* Snowflake Usage Result limit and Makefile ignore env fix
 2022-03-11 13:31:42 +05:30
Akash Jain
211a8a55e8
feat: Prepare 0.9.1-SNAPSHOT (#3297) 
* prepare snapshot version for 0.9.1

* prepare dev version for ingestion 0.9.1

* prepare dev version for ingestion-core 0.9.1

* prepare Docker CI workflows for 0.9.1
 2022-03-09 12:08:42 +05:30
Pere Miquel Brull
a9290bf1a0
Fix #3181 - Align ingestion requirements 
Fix ES and bump down redash (#3182)
 2022-03-06 09:00:58 +01:00