35 Commits

Author SHA1 Message Date
Sriharsha Chintalapani
50799227e4
Fix #2817: Remove indexing of Glossary as another Elasticsearch index (#2818) 2022-02-16 20:10:26 -08:00
Suresh Srinivas
28ba1a3c04
Fixes #2760 - Add entities for Glossary and initial API (#2761)
* Fixes #2760 - Add entities for Glossary and initial API

* Fixing merge issues
2022-02-15 20:54:46 -08:00
Ayush Shah
19e5f737ff
Usage fix - removed service_name from bulk_sink (#1956)
* Query Usage fixed

* Usage updated

* Reformatted change

* Usage files reformatted
2022-01-04 17:12:10 +05:30
Sriharsha Chintalapani
f33a08377c
Fix #1618: Fix usage query parsing (#1619) 2021-12-07 23:53:53 -08:00
Ayush Shah
47a97e7be0 FQN changed from bigquery to bigquery_gcp 2021-11-29 16:57:39 +05:30
Ayush Shah
759574a8de
Ingestion Optimization - Sample Users, Dockerfiles, Removal of Pandas (#935)
* Sample Profile Data for Sample Tables (#815)

* Sample Profile Data for Sample Tables

* Disabling Profile as Default

* Added Sample Profile Data to 3 additional sample tables

* Sample Tables fixed (#850)

* Pydantic fix, Docker update (#860)

* Setup.py Modified with openmetadata-airflow package, docker update

* Setup.py Modified

* Update setup.py

* Removed Pandas from Sample Data

* Sample Users added under sample data

* Sample User Standalone pipelines and modules removed

* Docker release package updated

* Dockerfile updated, removed redundant files

* Setup.py removed from ingestion src directory

* User Resource failing check resolved

* Modifying Usage Columns Datatype
2021-10-26 09:14:24 -07:00
Ayush Shah
72e4b8831f
Removing Cron from all configs (#773)
* Removing Cron from all configs

* Removing Cron from Documentation
2021-10-14 15:21:47 -07:00
Sriharsha Chintalapani
f7da8045b4
Fix #605: Ingestion: metadata list apis should paginate (#606)
* Fix #605: Ingestion: metadata list apis should paginate

* Fix #605: Ingestion: metadata list apis should paginate, Addressing review comments
2021-09-29 00:06:08 +05:30
Ayush Shah
627481f181
Status record Json encoding bug fixed and pandas not found fixed (#584) 2021-09-25 13:54:04 -07:00
Ayush Shah
7652baa00d
Setup.py Refactored, ES port fix (#521)
* Pylint build failure fixed

* Setup & dependency modified, Data profiler default to False, ES port fix

* Profiler requirements refactored

* Setup.py requirement fix

* openmetadata-ingestion version upgrade
2021-09-19 13:59:14 +05:30
Sriharsha Chintalapani
4c6c8fd446
Fix #515: Ingestion: Add ES configuration to allow port (#516) 2021-09-17 08:57:41 -07:00
Sriharsha Chintalapani
20a98aca81
Fix #396: Elastic search is not indexing usage for dashboard (#492) 2021-09-15 09:47:14 +05:30
Sriharsha Chintalapani
1c80dc246e
Fix #456: Make PII-Processor optional and independent install (#457) 2021-09-10 10:41:19 +05:30
Suresh Srinivas
328658ebea [WIP] profiler 2021-09-07 22:03:57 -07:00
Ayush Shah
657962bc4f
MSSQL sample-data query fix (#375)
* MSSQL sample-data query fix

* Query Format as per Database implemented
2021-09-06 21:03:04 -07:00
Sriharsha Chintalapani
d0dbcc19b7
Fix #401: Merge sample data generation into single connector (#402)
* Fix #401: Merge sample data generation into single connector

* Path for datasets modified

Co-authored-by: Ayush Shah <ayush@getcollate.io>
2021-09-05 22:35:02 +05:30
Sriharsha Chintalapani
59c74fffcd
Fix #393: ingestion support for indexing dashboard/charts entities (#394) 2021-09-03 14:54:05 +05:30
parthp2107
d3d0ac19d0
Removed serviceType as a configuration option from workflow configs (#371)
* Removed serviceType as a configuration option from workflow configs

* Removed serviceType as a configuration option from workflow configs

Co-authored-by: parthp2107 <parth.panchal@deuexsoultions.com>
2021-09-02 19:45:41 +05:30
Suresh Srinivas
fd99dbdb1a Fix #339: Add sample dashboards & charts 2021-08-30 22:13:45 -07:00
Suresh Srinivas
994b49d055 Fix #281: Ingestion: Add a sample topics connector 2021-08-23 14:59:39 -07:00
Suresh Srinivas
96285c578a Issue-261: Ingestion: Make ES Sink as a single record update; Add support for Topics index 2021-08-21 22:29:30 -07:00
Ayush Shah
c542ffd41d Added Row Data to Sample Tables 2021-08-20 01:21:14 +05:30
Ayush Shah
f5194669ae Filter Pattern Modification 2021-08-15 01:20:12 +05:30
Ayush Shah
03ad583744 Registry dependency removed 2021-08-14 00:09:51 +05:30
Ayush Shah
042ef45ca4 Registry Cleanup 2021-08-13 20:35:17 +05:30
Suresh Srinivas
a2403b4570 Ingestion: add sample usage connector 2021-08-13 00:33:48 -07:00
Ayush Shah
d9cd3e4856 Connector Dependency Cleanup and Docker Modification 2021-08-13 02:29:36 +05:30
Ayush Shah
3810d6fb5f Postgres pattern and col type handling 2021-08-12 01:25:50 +05:30
Suresh Srinivas
df49235748 ingestion refactor 2021-08-10 20:44:46 -07:00
Suresh Srinivas
f0bcbdad1a ingestion refactor 2021-08-10 20:37:31 -07:00
Suresh Srinivas
4371e7a6f0 Fix: usage connectors 2021-08-10 15:00:41 -07:00
Suresh Srinivas
a674f5bc2e Ingestion Refactor 2021-08-10 11:28:15 -07:00
Ayush Shah
87764d723d Pipeline Credential Changes 2021-08-09 09:31:43 +05:30
Ayush Shah
d9551ed337
Fix #15 (#16)
* Fix #15

* Pylint Relative Imports handled

* Final Newline lint error resolved

* Pylint Unused Imports handled

* Pylint command modified

* AllowDenyPattern error resolved

* EntityReference changes for common to entityReference

* vscode settings removed

* Resolved reoccuring function

* pylintrc file implemented

* Fix pylintrc file

* Pylint Errors resolved + import errors resolved and includepattern included

Co-authored-by: Suresh Srinivas <srini3005@gmail.com>
2021-08-07 11:00:35 +05:30
sureshms
8ce7c879e8 OpenMetadata snapshot release 0.3 2021-08-01 14:27:44 -07:00