yujunjun/OpenMetadata
1
0
Fork 0
mirror of https://github.com/open-metadata/OpenMetadata.git synced 2025-07-24 01:40:00 +00:00
Code Issues Packages Projects Releases Wiki Activity
3,072 Commits 700 Branches 148 Tags
Commit Graph

149 Commits

Author SHA1 Message Date
Sriharsha Chintalapani
7b637d4628
Fix #1665: Oracle connector add an option to configure oracle service name (#1666) 
* Fix #1665: Oracle connector add an option to configure oracle service name

* Fixed removal of semi colon

Fixes SQL Command Warning while ingesting

Co-authored-by: Akash Jain <15995028+akash-jain-10@users.noreply.github.com>
 2021-12-10 16:37:19 +05:30
Sriharsha Chintalapani
6f0ef68701
Fix #1392: parse exclude/include filters from UI generated config (#1634) 2021-12-10 15:17:43 +05:30
Sriharsha Chintalapani
c8c57de37e
Issue 1658: Ingestion changes to add dbtModel as part of Table entity (#1659) 
* Fix #1658: Ingestion changes to add dbtModel as part of Table entity

* Fixes #1652 Remove DBTModel as top level entity and capture information from DBT in existing Table entity

Co-authored-by: sureshms <suresh@getcollate.io>
 2021-12-09 20:32:17 -08:00
Ayush Shah
7263510124
Query Log fixed (#1615) 
* Query Log fixed

* Wrong ColumnName fixed

* Added Service Name in usage configs
 2021-12-08 07:36:45 -08:00
Ayush Shah
67433f559c
Trino JDBC updated (#1614) 2021-12-08 13:14:38 +05:30
Alberto Miorin
8621ee3fa0
Fix #1533, #1522: (#1575) 
- Glue works with columns containing dots.
- Glue works with temporary credentials.
- Fix bug in TableRepository, the EntityType was database instead of table.
- only region_name is mandatory in Glue config.
- first integration test for Glue. The CI integration with AWS is still missing.
 2021-12-06 16:03:05 -08:00
Sriharsha Chintalapani
e4fa0247f5
Fix #1280: Amundsen connector to import metadata (#1281) 
* Fix #1280: Amundsen connector to import metadata
 2021-11-20 14:08:27 -08:00
Ayush Shah
219246b78e
Glue pagination added (#1282) 2021-11-20 12:46:18 -08:00
Sriharsha Chintalapani
f3054658f5
Fix #968: Add DBT Connector (#1200) 2021-11-16 01:02:45 -08:00
Sriharsha Chintalapani
f018664e0c
Issue-1197: Add MariaDB Connector (#1198) 2021-11-16 00:25:24 -08:00
Ayush Shah
9839191242
Issue 483 - Glue Implementation (#1124) 
* Glue Tables and Pipeline workflows implemented

* Glue Config Added

* Relative imports changed to absolute

* Resolving Comments - Changed Imports, serviceTypes

* Type fixed in setup.py
 2021-11-10 07:28:13 -08:00
Ayush Shah
72e4b8831f
Removing Cron from all configs (#773) 
* Removing Cron from all configs

* Removing Cron from Documentation
 2021-10-14 15:21:47 -07:00
Ayush Shah
a19c5bceca
Trino fix #705 (#706) 
* Trino fix #705

* Update trino.json to point to default database
 2021-10-07 12:25:03 -07:00
James
d455409cc9
issue-696: Added trino support for Openmetadata (#697) 
* issue-696: Added trino support for Openmetadata

* issue-696: fixed linting issues

* issue-696: not mentioning Trino for now as it will be part of 0.5 release

Co-authored-by: jbuoncri <jbuoncri@cisco.com>
 2021-10-07 11:15:34 -07:00
Sriharsha Chintalapani
1361bace11
sample entity generation (#646) 
* 1M entities to test scalability

* 1M entities to test scalability

* 1M entities test

* column name modification

* Fix service add and tags

* Add sample entity generation

Co-authored-by: parthp2107 <parth@getcollate.io>
Co-authored-by: Ayush Shah <ayush@getcollate.io>
 2021-10-04 22:56:28 +05:30
Sriharsha Chintalapani
eb2717b0e3
Fix #587: Ingestion: Add standalone report process to generate datasets, usage & profile and serve from standalone server (#588) 
* Fix #587: Ingestion: Add standalone report process to generate datasets, usage & profile and serve from standalone server

* add localhost
 2021-09-27 08:43:38 -07:00
parthp2107
06810cdec1
Fix #432:Added Redash Connector (#444) 
* added redash connector

* added redash connector

* Added Redash Connector

* minor changes

Co-authored-by: parthp2107 <parth.panchal@deuexsoultions.com>
Co-authored-by: parthp2107 <parth@getcollate.io>
 2021-09-22 15:09:24 +05:30
Ayush Shah
7bc2b14178
Added and Modified Redshift Pipeline (#528) 
* Pylint build failure fixed

* Redshift workflow added
 2021-09-19 21:16:50 -07:00
Ayush Shah
7652baa00d
Setup.py Refactored, ES port fix (#521) 
* Pylint build failure fixed

* Setup & dependency modified, Data profiler default to False, ES port fix

* Profiler requirements refactored

* Setup.py requirement fix

* openmetadata-ingestion version upgrade
 2021-09-19 13:59:14 +05:30
Sriharsha Chintalapani
b7adb5dc6b
Fix #469: Add Vertica Connector (#470) 2021-09-12 21:59:31 -07:00
Ayush Shah
d2df40cf2b
Fix #355: Tableau Implemented (#468) 
* Fix #355: Tableau Implemented

* Tableau pipeline location modification
 2021-09-11 11:46:10 -07:00
Sriharsha Chintalapani
1c80dc246e
Fix #456: Make PII-Processor optional and independent install (#457) 2021-09-10 10:41:19 +05:30
Suresh Srinivas
328658ebea [WIP] profiler 2021-09-07 22:03:57 -07:00
parthp2107
3965b030a9
Added Salesforce Connector (#423) 
* Added salesforce-connector

* minor changes

* Added Salesforce-connector

* Added Salesforce-connector

* Salesforce sample data implemented

Co-authored-by: parthp2107 <parth.panchal@deuexsoultions.com>
Co-authored-by: Ayush Shah <ayush@getcollate.io>
 2021-09-08 00:37:13 +05:30
Ayush Shah
657962bc4f
MSSQL sample-data query fix (#375) 
* MSSQL sample-data query fix

* Query Format as per Database implemented
 2021-09-06 21:03:04 -07:00
Sriharsha Chintalapani
eff1de87ef
Fix #381: SQLAlchemy URL is causing issues in creating service (#383) 2021-09-02 20:36:18 -07:00
Ayush Shah
c9ada4ca1a
Looker Dashboard Connecter Added (#351) 
* Looker Dashboard Connecter Added

* Dashboard yield fixed

* Looker Connector Method modifications
 2021-09-02 20:32:03 -07:00
parthp2107
d3d0ac19d0
Removed serviceType as a configuration option from workflow configs (#371) 
* Removed serviceType as a configuration option from workflow configs

* Removed serviceType as a configuration option from workflow configs

Co-authored-by: parthp2107 <parth.panchal@deuexsoultions.com>
 2021-09-02 19:45:41 +05:30
Suresh Srinivas
bd0c65f3e4 Fix #331: Integrate superset connector to OpenMetadata APIs 2021-08-27 21:33:42 -07:00
Suresh Srinivas
c36727aaf9
Merge pull request #307 from open-metadata/bigqueryusage-pipeline 
Bigquery Usage Pipeline added
 2021-08-26 22:24:09 -07:00
Suresh Srinivas
c790d4fc75
Merge pull request #291 from open-metadata/bigquery-optimize 
Added credentials path to the bigquery config
 2021-08-26 22:22:57 -07:00
Ayush Shah
820af4629c RedshiftConfig Filter Modified 2021-08-26 01:42:19 +05:30
Ayush Shah
a58cae7286 Pipeline config changes 2021-08-26 01:19:32 +05:30
Ayush Shah
bd40ae45ce Bigquery Usage Pipeline added 2021-08-26 01:15:02 +05:30
Suresh Srinivas
6a28ae988f [WIP] Issue #285: Add support for Dashboard Entities; Superset connector 2021-08-24 13:47:41 -07:00
Ayush Shah
c813e8f71b Added credentials path to the bigquery config 2021-08-24 23:53:34 +05:30
Ayush Shah
07dd7b36f4 Pipeline Ingestion refactoring 2021-08-24 18:49:53 +05:30
Ayush Shah
f543c3f99b Pipeline Fixes 2021-08-24 18:49:53 +05:30
Suresh Srinivas
4533bc49cb
Merge pull request #258 from open-metadata/kafka-pulsar 
Kafka pulsar APIs & Kafka connector
 2021-08-21 20:17:54 -07:00
Suresh Srinivas
19151dcac7 Ingestion: Add Kafka Connector 2021-08-21 17:52:24 -07:00
Suresh Srinivas
dc7e05dd74 Ingestion: Add Confluent Kafka topic and schema connector 2021-08-21 13:16:40 -07:00
Suresh Srinivas
be2d55ba1e Ingestion: close sql connection 2021-08-20 11:18:29 -07:00
Suresh Srinivas
6b5dd36672 ISSUE-243: Generate sample data 2021-08-19 19:39:57 -07:00
Suresh Srinivas
c1c39053cc ISSUE-243: Generate sample data 2021-08-19 16:26:01 -07:00
Suresh Srinivas
4d389b3a30 ISSUE-249: Ingest views into OpenMetadata 2021-08-19 13:33:07 -07:00
Suresh Srinivas
2d70350742
Update python json schema classes; Add presto connector (#213) 
* Update python json schema classes; Add presto connector

* Modification in Postgres, pylint and presto support

Co-authored-by: Suresh Srinivas <srini3005@gmail.com>
Co-authored-by: Ayush Shah <ayush02shah12@gmail.com>
 2021-08-17 21:15:46 +05:30
Ayush Shah
f5194669ae Filter Pattern Modification 2021-08-15 01:20:12 +05:30
Ayush Shah
03ad583744 Registry dependency removed 2021-08-14 00:09:51 +05:30
Suresh Srinivas
b016b01ece Ingestion: add sample usage connector 2021-08-12 21:26:27 -07:00