From 769e681348aeab6708ea971cbbfe3340ce17aed1 Mon Sep 17 00:00:00 2001 From: Rounak Dhillon <162090200+RounakDhillon@users.noreply.github.com> Date: Tue, 25 Feb 2025 19:14:44 +0530 Subject: [PATCH] Docs: Code Layout Updation (#19971) --- .../v1.6.x/developers/architecture/code-layout.md | 9 +-------- .../developers/architecture/code-layout.md | 9 +-------- 2 files changed, 2 insertions(+), 16 deletions(-) diff --git a/openmetadata-docs/content/v1.6.x/developers/architecture/code-layout.md b/openmetadata-docs/content/v1.6.x/developers/architecture/code-layout.md index 80cb3ac50d5..9c75d430111 100644 --- a/openmetadata-docs/content/v1.6.x/developers/architecture/code-layout.md +++ b/openmetadata-docs/content/v1.6.x/developers/architecture/code-layout.md @@ -62,14 +62,7 @@ Ingestion is a simple Python framework to ingest metadata from external sources **Connectors** -OpenMetadata defines and uses a set of components called `Connectors` for metadata ingestion. Each data service requires its own connector. See the documentation on how to [build a connector]() for details on developing connectors for new services. - -1. Workflow [`OpenMetadata/ingestion/src/metadata/ingestion/api/workflow.py`](https://github.com/open-metadata/OpenMetadata/blob/main/ingestion/src/metadata/ingestion/api/workflow.py) -2. Source [`OpenMetadata/ingestion/src/metadata/ingestion/api/source.py`](https://github.com/open-metadata/OpenMetadata/blob/main/ingestion/src/metadata/ingestion/api/source.py) -3. Processor [`OpenMetadata/ingestion/src/metadata/ingestion/api/processor.py`](https://github.com/open-metadata/OpenMetadata/blob/main/ingestion/src/metadata/ingestion/api/processor.py) -4. Sink [`OpenMetadata/ingestion/src/metadata/ingestion/api/sink.py`](https://github.com/open-metadata/OpenMetadata/blob/main/ingestion/src/metadata/ingestion/api/sink.py) -5. Stage [`OpenMetadata/ingestion/src/metadata/ingestion/api/stage.py`](https://github.com/open-metadata/OpenMetadata/blob/main/ingestion/src/metadata/ingestion/api/stage.py) -6. BulkSink [`OpenMetadata/ingestion/src/metadata/ingestion/api/bulk_sink.py`](https://github.com/open-metadata/OpenMetadata/blob/main/ingestion/src/metadata/ingestion/api/bulk_sink.py) +OpenMetadata defines and uses a set of components called `Connectors` for metadata ingestion. Each data service requires its own connector. See the documentation on how to [build a connector](/developers/contribute/developing-a-new-connector) for details on developing connectors for new services. Workflow is a simple orchestration job that runs `Source`, `Processor`, `Sink`, `Stage` and `BulkSink` based on the configurations present under [`OpenMetadata/ingestion/examples/workflows`](https://github.com/open-metadata/OpenMetadata/tree/main/ingestion/src/metadata/examples/workflows). diff --git a/openmetadata-docs/content/v1.7.x-SNAPSHOT/developers/architecture/code-layout.md b/openmetadata-docs/content/v1.7.x-SNAPSHOT/developers/architecture/code-layout.md index ed0a4288f1a..b478e37da7c 100644 --- a/openmetadata-docs/content/v1.7.x-SNAPSHOT/developers/architecture/code-layout.md +++ b/openmetadata-docs/content/v1.7.x-SNAPSHOT/developers/architecture/code-layout.md @@ -62,14 +62,7 @@ Ingestion is a simple Python framework to ingest metadata from external sources **Connectors** -OpenMetadata defines and uses a set of components called `Connectors` for metadata ingestion. Each data service requires its own connector. See the documentation on how to [build a connector]() for details on developing connectors for new services. - -1. Workflow [`OpenMetadata/ingestion/src/metadata/ingestion/api/workflow.py`](https://github.com/open-metadata/OpenMetadata/blob/main/ingestion/src/metadata/ingestion/api/workflow.py) -2. Source [`OpenMetadata/ingestion/src/metadata/ingestion/api/source.py`](https://github.com/open-metadata/OpenMetadata/blob/main/ingestion/src/metadata/ingestion/api/source.py) -3. Processor [`OpenMetadata/ingestion/src/metadata/ingestion/api/processor.py`](https://github.com/open-metadata/OpenMetadata/blob/main/ingestion/src/metadata/ingestion/api/processor.py) -4. Sink [`OpenMetadata/ingestion/src/metadata/ingestion/api/sink.py`](https://github.com/open-metadata/OpenMetadata/blob/main/ingestion/src/metadata/ingestion/api/sink.py) -5. Stage [`OpenMetadata/ingestion/src/metadata/ingestion/api/stage.py`](https://github.com/open-metadata/OpenMetadata/blob/main/ingestion/src/metadata/ingestion/api/stage.py) -6. BulkSink [`OpenMetadata/ingestion/src/metadata/ingestion/api/bulk_sink.py`](https://github.com/open-metadata/OpenMetadata/blob/main/ingestion/src/metadata/ingestion/api/bulk_sink.py) +OpenMetadata defines and uses a set of components called `Connectors` for metadata ingestion. Each data service requires its own connector. See the documentation on how to [build a connector](/developers/contribute/developing-a-new-connector) for details on developing connectors for new services. Workflow is a simple orchestration job that runs `Source`, `Processor`, `Sink`, `Stage` and `BulkSink` based on the configurations present under [`OpenMetadata/ingestion/examples/workflows`](https://github.com/open-metadata/OpenMetadata/tree/main/ingestion/src/metadata/examples/workflows).