yujunjun/OpenMetadata
1
0
Fork 0
mirror of https://github.com/open-metadata/OpenMetadata.git synced 2026-01-08 21:48:22 +00:00
Code Issues Packages Projects Releases Wiki Activity
OpenMetadata/ingestion
History
Pere Miquel Brull f33003485e
ES reindex Airflow workflow (#8723) 
* Added support for 'Metadata Service' connectors

* Fixed failing unit tests

* Removed delete button for 'Metadata Service' connector of type OpenMetadataServer

* Code optimization for SelectServiceType component

* Fixed errors arrived due to backend changes related to OpenMetadata Services

* init reindex

* Added additional step for adding Metadata to ES configs while creating ingestion pipeline for Metadata Service

* Add ES reindex

* Add ES reindex

* Format

* Format

* Rename service

* Pick service name from IngestionPipeline

* fix ui conflicts

Co-authored-by: Aniket Katkar <aniketkatkar97@gmail.com>
Co-authored-by: Chirag Madlani <12962843+chirag-madlani@users.noreply.github.com>
2022-11-14 18:59:56 +01:00
..
connectors
Remove Click and Add ArgParse (#8182)
2022-10-31 18:12:26 +05:30
examples
Add queries in sample data for lineage (#8674)
2022-11-14 13:11:16 +05:30
operators
Add Airflow deps installation (#8131)
2022-10-13 11:06:27 +02:00
pipelines
ES reindex Airflow workflow (#8723)
2022-11-14 18:59:56 +01:00
src
ES reindex Airflow workflow (#8723)
2022-11-14 18:59:56 +01:00
tests
Mapping from kpi to dichart(One to one) (#8707)
2022-11-14 19:44:01 +05:30
__init__.py
…
.coveragerc
Prepare CI for Airflow APIs (#6240)
2022-07-21 12:29:57 +02:00
Dockerfile
Fix Mysql bigint (#8665)
2022-11-11 10:12:23 +01:00
Dockerfile.ci
Fix Mysql bigint (#8665)
2022-11-11 10:12:23 +01:00
ingestion_dependency.sh
Prepare Ingestion Base Docker image (#8065)
2022-10-11 07:50:49 +02:00
LICENSE
…
README.md
Fix (#6984) doc links in OpenMetaData (#6986)
2022-08-29 19:38:54 +05:30
setup.cfg
Fix#7272: Improve logging when initializing workflow from CLI (#7522)
2022-09-19 08:00:00 -07:00
setup.py
Fix PyMSSQL Version (#8696)
2022-11-14 08:40:41 +01:00
sonar-project.properties
Fix SonarCloud coverage for Python code (#8144)
2022-10-14 15:17:40 +02:00

README.md

This guide will help you setup the Ingestion framework and connectors
This guide will help you setup the Ingestion framework and connectors

Python version 3.8+

OpenMetadata Ingestion is a simple framework to build connectors and ingest metadata of various systems through OpenMetadata APIs. It could be used in an orchestration framework(e.g. Apache Airflow) to ingest metadata. Prerequisites

  • Python >= 3.8.x

Docs

Please refer to the documentation here https://docs.open-metadata.org/openmetadata/connectors