411 Commits

Author SHA1 Message Date
Sriharsha Chintalapani
eb2717b0e3
Fix #587: Ingestion: Add standalone report process to generate datasets, usage & profile and serve from standalone server (#588)
* Fix #587: Ingestion: Add standalone report process to generate datasets, usage & profile and serve from standalone server

* add localhost
2021-09-27 08:43:38 -07:00
parthp2107
06810cdec1
Fix #432:Added Redash Connector (#444)
* added redash connector

* added redash connector

* Added Redash Connector

* minor changes

Co-authored-by: parthp2107 <parth.panchal@deuexsoultions.com>
Co-authored-by: parthp2107 <parth@getcollate.io>
2021-09-22 15:09:24 +05:30
Ayush Shah
7bc2b14178
Added and Modified Redshift Pipeline (#528)
* Pylint build failure fixed

* Redshift workflow added
2021-09-19 21:16:50 -07:00
Ayush Shah
7652baa00d
Setup.py Refactored, ES port fix (#521)
* Pylint build failure fixed

* Setup & dependency modified, Data profiler default to False, ES port fix

* Profiler requirements refactored

* Setup.py requirement fix

* openmetadata-ingestion version upgrade
2021-09-19 13:59:14 +05:30
Sriharsha Chintalapani
b7adb5dc6b
Fix #469: Add Vertica Connector (#470) 2021-09-12 21:59:31 -07:00
Ayush Shah
d2df40cf2b
Fix #355: Tableau Implemented (#468)
* Fix #355: Tableau Implemented

* Tableau pipeline location modification
2021-09-11 11:46:10 -07:00
Sriharsha Chintalapani
ed698dc40f
Fix #466: Fix airflow example dag (#467) 2021-09-10 22:28:23 -07:00
Sriharsha Chintalapani
1c80dc246e
Fix #456: Make PII-Processor optional and independent install (#457) 2021-09-10 10:41:19 +05:30
Suresh Srinivas
30c1e5a14c
Merge pull request #447 from open-metadata/Issue-446
Fix #446: Add DataProfiler to ingestion and APIs
2021-09-09 11:25:56 -07:00
Ayush Shah
bdad904e82
Sample Data ingestion fix (#437) 2021-09-08 16:52:54 +05:30
Suresh Srinivas
328658ebea [WIP] profiler 2021-09-07 22:03:57 -07:00
Ayush Shah
2b61c8ea8c
fix Issue-404 replicationFactor and Message Maximum Byte added (#419)
* fix Issue-404 replicationFactor and Message Maximum Byte added

* Cleanup Policy values changed in sample topic data
2021-09-07 12:22:51 -07:00
parthp2107
3965b030a9
Added Salesforce Connector (#423)
* Added salesforce-connector

* minor changes

* Added Salesforce-connector

* Added Salesforce-connector

* Salesforce sample data implemented

Co-authored-by: parthp2107 <parth.panchal@deuexsoultions.com>
Co-authored-by: Ayush Shah <ayush@getcollate.io>
2021-09-08 00:37:13 +05:30
Ayush Shah
657962bc4f
MSSQL sample-data query fix (#375)
* MSSQL sample-data query fix

* Query Format as per Database implemented
2021-09-06 21:03:04 -07:00
Sriharsha Chintalapani
d0dbcc19b7
Fix #401: Merge sample data generation into single connector (#402)
* Fix #401: Merge sample data generation into single connector

* Path for datasets modified

Co-authored-by: Ayush Shah <ayush@getcollate.io>
2021-09-05 22:35:02 +05:30
Sriharsha Chintalapani
eff1de87ef
Fix #381: SQLAlchemy URL is causing issues in creating service (#383) 2021-09-02 20:36:18 -07:00
Ayush Shah
c9ada4ca1a
Looker Dashboard Connecter Added (#351)
* Looker Dashboard Connecter Added

* Dashboard yield fixed

* Looker Connector Method modifications
2021-09-02 20:32:03 -07:00
parthp2107
d3d0ac19d0
Removed serviceType as a configuration option from workflow configs (#371)
* Removed serviceType as a configuration option from workflow configs

* Removed serviceType as a configuration option from workflow configs

Co-authored-by: parthp2107 <parth.panchal@deuexsoultions.com>
2021-09-02 19:45:41 +05:30
Sriharsha Chintalapani
193c6a782a Fix #346: Add displayName to Chart and Dashboard entities and use the dashboard and chart ids/unique identifiers in name field 2021-08-31 23:49:01 -07:00
Suresh Srinivas
fd99dbdb1a Fix #339: Add sample dashboards & charts 2021-08-30 22:13:45 -07:00
Suresh Srinivas
bd0c65f3e4 Fix #331: Integrate superset connector to OpenMetadata APIs 2021-08-27 21:33:42 -07:00
Suresh Srinivas
c36727aaf9
Merge pull request #307 from open-metadata/bigqueryusage-pipeline
Bigquery Usage Pipeline added
2021-08-26 22:24:09 -07:00
Suresh Srinivas
aa0ab362e6
Merge pull request #289 from open-metadata/issue-288
Ingestion of Sample Data fixed - #288
2021-08-26 22:23:22 -07:00
Suresh Srinivas
c790d4fc75
Merge pull request #291 from open-metadata/bigquery-optimize
Added credentials path to the bigquery config
2021-08-26 22:22:57 -07:00
Suresh Srinivas
9bff3ccba9 Fix #317: Ingestion bug introduced due to auth_token 2021-08-26 17:39:35 -07:00
Suresh Srinivas
afb0d724eb Fix #317: Ingestion bug introduced due to auth_token 2021-08-26 16:26:34 -07:00
Suresh Srinivas
8a5484144e
Merge pull request #292 from open-metadata/superset_connector
Add Dashboard, Chart and Dashboard Service entities; Superset connector
2021-08-26 09:28:51 -07:00
Ayush Shah
820af4629c RedshiftConfig Filter Modified 2021-08-26 01:42:19 +05:30
Ayush Shah
a58cae7286 Pipeline config changes 2021-08-26 01:19:32 +05:30
Ayush Shah
bd40ae45ce Bigquery Usage Pipeline added 2021-08-26 01:15:02 +05:30
Suresh Srinivas
7a0d9c867c Fix #287: search api not returning all aggregations for Topics index 2021-08-24 14:39:02 -07:00
Suresh Srinivas
6a28ae988f [WIP] Issue #285: Add support for Dashboard Entities; Superset connector 2021-08-24 13:47:41 -07:00
Ayush Shah
c813e8f71b Added credentials path to the bigquery config 2021-08-24 23:53:34 +05:30
Ayush Shah
b2bc913d80 Ingestion of Sample Data fixed - #288 2021-08-24 23:33:48 +05:30
Ayush Shah
07dd7b36f4 Pipeline Ingestion refactoring 2021-08-24 18:49:53 +05:30
Ayush Shah
f543c3f99b Pipeline Fixes 2021-08-24 18:49:53 +05:30
Suresh Srinivas
994b49d055 Fix #281: Ingestion: Add a sample topics connector 2021-08-23 14:59:39 -07:00
Ayush Shah
cf0dcf8142
tableType error elasticsearch fixed (#273) 2021-08-23 13:30:40 +05:30
Suresh Srinivas
4533bc49cb
Merge pull request #258 from open-metadata/kafka-pulsar
Kafka pulsar APIs & Kafka connector
2021-08-21 20:17:54 -07:00
Suresh Srinivas
19151dcac7 Ingestion: Add Kafka Connector 2021-08-21 17:52:24 -07:00
Suresh Srinivas
dc7e05dd74 Ingestion: Add Confluent Kafka topic and schema connector 2021-08-21 13:16:40 -07:00
Suresh Srinivas
be2d55ba1e Ingestion: close sql connection 2021-08-20 11:18:29 -07:00
Suresh Srinivas
6b5dd36672 ISSUE-243: Generate sample data 2021-08-19 19:39:57 -07:00
Suresh Srinivas
c1c39053cc ISSUE-243: Generate sample data 2021-08-19 16:26:01 -07:00
Suresh Srinivas
dc43efa81c
Merge pull request #238 from open-metadata/sample-table-rows
Added sampleData support for sample tables
2021-08-19 14:03:50 -07:00
Suresh Srinivas
4d389b3a30 ISSUE-249: Ingest views into OpenMetadata 2021-08-19 13:33:07 -07:00
Ayush Shah
c542ffd41d Added Row Data to Sample Tables 2021-08-20 01:21:14 +05:30
Suresh Srinivas
2d70350742
Update python json schema classes; Add presto connector (#213)
* Update python json schema classes; Add presto connector

* Modification in Postgres, pylint and presto support

Co-authored-by: Suresh Srinivas <srini3005@gmail.com>
Co-authored-by: Ayush Shah <ayush02shah12@gmail.com>
2021-08-17 21:15:46 +05:30
Suresh Srinivas
214d129352
Merge pull request #170 from open-metadata/docUpdate.part13
Doc update.part13
2021-08-14 16:54:34 -07:00
sureshms
9dfe8f751f Documentation update part13 - Add descriptions to tags 2021-08-14 16:53:38 -07:00