yujunjun/OpenMetadata
1
0
Fork 0
mirror of https://github.com/open-metadata/OpenMetadata.git synced 2025-10-19 04:41:02 +00:00
Code Issues Packages Projects Releases Wiki Activity

Add ingestion docs to implement a connector

Browse Source
This commit is contained in:
Suresh Srinivas 2021-08-16 15:51:04 -07:00
parent d7f5df359a
commit 2df2e89c60
2 changed files with 8 additions and 5 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

5
docs/SUMMARY.md
View File

@ -77,6 +77,11 @@
* [Coding Style](open-source-community/developer/coding-style.md) * [Coding Style](open-source-community/developer/coding-style.md)
* [Build the code & run tests](open-source-community/developer/build-code-run-tests.md) * [Build the code & run tests](open-source-community/developer/build-code-run-tests.md)
* [Build a Connector](open-source-community/developer/build-a-connector/README.md) * [Build a Connector](open-source-community/developer/build-a-connector/README.md)
* [Source](open-source-community/developer/build-a-connector/source.md)
* [Processor](open-source-community/developer/build-a-connector/processor.md)
* [Sink](open-source-community/developer/build-a-connector/sink.md)
* [Stage](open-source-community/developer/build-a-connector/stage.md)
* [BulkSink](open-source-community/developer/build-a-connector/bulksink.md)
* [Run Integration Tests](open-source-community/developer/run-integration-tests.md) * [Run Integration Tests](open-source-community/developer/run-integration-tests.md)
* [UX Style Guide](open-source-community/developer/ux-style-guide.md) * [UX Style Guide](open-source-community/developer/ux-style-guide.md)

8
docs/open-source-community/developer/build-a-connector/README.md
View File

@ -3,13 +3,11 @@ description: >-
This design doc will walk through developing a connector for OpenMetadata This design doc will walk through developing a connector for OpenMetadata
--- ---
# Ingestion
# Ingestion API
Ingestion is a simple python framework to ingest the metadata from various sources. Ingestion is a simple python framework to ingest the metadata from various sources.
##API
Please look at our framework [APIs](https://github.com/open-metadata/OpenMetadata/tree/main/ingestion/src/metadata/ingestion/api) Please look at our framework [APIs](https://github.com/open-metadata/OpenMetadata/tree/main/ingestion/src/metadata/ingestion/api)
@ -17,7 +15,7 @@ Please look at our framework [APIs](https://github.com/open-metadata/OpenMetadat
[workflow](https://github.com/open-metadata/OpenMetadata/blob/main/ingestion/src/metadata/ingestion/api/workflow.py) is a simple orchestration job that runs the components in an Order. [workflow](https://github.com/open-metadata/OpenMetadata/blob/main/ingestion/src/metadata/ingestion/api/workflow.py) is a simple orchestration job that runs the components in an Order.
It Consists of [Source](./source.md) , Optional [Processor](./processor.md), [Sink](./sink.md) . It also provides support for [Stage](./stage.md) , [BulkSink](./bulksink.md) It consists of [Source](./source.md) ,[Processor](./processor.md), [Sink](./sink.md) . It also provides support for [Stage](./stage.md) , [BulkSink](./bulksink.md)
Workflow execution happens in serial fashion. Workflow execution happens in serial fashion.