mirror of
https://github.com/open-metadata/OpenMetadata.git
synced 2025-07-03 23:26:54 +00:00
31 lines
1.0 KiB
Markdown
31 lines
1.0 KiB
Markdown
---
|
|
This guide will help you setup the Ingestion framework and connectors
|
|
---
|
|
|
|
|
|
|
|
OpenMetadata Ingestion is a simple framework to build connectors and ingest metadata of various systems through OpenMetadata APIs. It could be used in an orchestration framework(e.g. Apache Airflow) to ingest metadata.
|
|
**Prerequisites**
|
|
|
|
- Python >= 3.8.x
|
|
|
|
### Docs
|
|
|
|
Please refer to the documentation here https://docs.open-metadata.org/connectors
|
|
|
|
<img referrerpolicy="no-referrer-when-downgrade" src="https://static.scarf.sh/a.png?x-pxid=c1a30c7c-6dc7-4928-95bf-6ee08ca6aa6a" />
|
|
|
|
### TopologyRunner
|
|
|
|
All the Ingestion Workflows run through the TopologyRunner.
|
|
|
|
The flow is depicted in the images below.
|
|
|
|
**TopologyRunner Standard Flow**
|
|
|
|
|
|
|
|
**TopologyRunner Multithread Flow**
|
|
|
|
|