yujunjun/OpenMetadata
1
0
Fork 0
mirror of https://github.com/open-metadata/OpenMetadata.git synced 2025-08-22 16:08:13 +00:00
Code Issues Packages Projects Releases Wiki Activity

Add ingestion docs to implement a connector

Browse Source
This commit is contained in:
Suresh Srinivas 2021-08-16 15:58:44 -07:00
parent 4d74050884
commit 192672f1a5
1 changed files with 2 additions and 2 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

4
docs/open-source-community/developer/build-a-connector/README.md
View File

@ -19,8 +19,8 @@ It consists of [Source](./source.md) ,[Processor](./processor.md), [Sink](./sink
Workflow execution happens in serial fashion. Workflow execution happens in serial fashion.
1. It runs **source** component first. Source component retrieves a record from external sources and emits the record downstream. 1. It runs **source** component first. **Source** component retrieves a record from external sources and emits the record downstream.
2. if **processor** component is configured it sends the record to processor first 2. if the **processor** component is configured **workflow** sends the record to processor next
3. There can be multiple processors attached to the workflow it passes them in the order they are configurd 3. There can be multiple processors attached to the workflow it passes them in the order they are configurd
4. Once the **processors** finished , it sends the modified to record to Sink. 4. Once the **processors** finished , it sends the modified to record to Sink.
5. The above steps repeats per record emitted from source component 5. The above steps repeats per record emitted from source component