yujunjun/OpenMetadata
1
0
Fork 0
mirror of https://github.com/open-metadata/OpenMetadata.git synced 2025-08-21 23:48:47 +00:00
Code Issues Packages Projects Releases Wiki Activity

Kafka Schema Registry Note (#10255)

Browse Source
This commit is contained in:
Mayur Singal 2023-02-21 17:26:50 +05:30 committed by GitHub
parent 46bdc8ab64
commit b2aab148fa
No known key found for this signature in database
GPG Key ID: 4AEE18F83AFDEB23
6 changed files with 37 additions and 0 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

7
openmetadata-docs/content/connectors/messaging/kafka/airflow.md
View File

@ -83,6 +83,13 @@ workflowConfig:
- **consumerConfig**: Confluent Kafka Consumer Config.
- **schemaRegistryConfig**:Confluent Kafka Schema Registry Config.
<Note>
To ingest the topic schema `schemaRegistryURL` must be passed
</Note>
#### Source Configuration - Source Config
The sourceConfig is defined [here](https://github.com/open-metadata/OpenMetadata/blob/main/openmetadata-spec/src/main/resources/json/schema/metadataIngestion/messagingServiceMetadataPipeline.json):

6
openmetadata-docs/content/connectors/messaging/kafka/cli.md
View File

@ -83,6 +83,12 @@ workflowConfig:
- **consumerConfig**: Confluent Kafka Consumer Config.
- **schemaRegistryConfig**:Confluent Kafka Schema Registry Config.
<Note>
To ingest the topic schema `schemaRegistryURL` must be passed
</Note>
#### Source Configuration - Source Config
The sourceConfig is defined [here](https://github.com/open-metadata/OpenMetadata/blob/main/openmetadata-spec/src/main/resources/json/schema/metadataIngestion/messagingServiceMetadataPipeline.json):

6
openmetadata-docs/content/connectors/messaging/kafka/index.md
View File

@ -134,6 +134,12 @@ the changes.
- **Consumer Config**: Confluent Kafka Consumer Config.
- **Schema Registry Config**:Confluent Kafka Schema Registry Config.
<Note>
To ingest the topic schema `Schema Registry URL` must be passed
</Note>
### 6. Configure Metadata Ingestion
In this step we will configure the metadata ingestion pipeline,

6
openmetadata-docs/content/connectors/messaging/redpanda/airflow.md
View File

@ -83,6 +83,12 @@ workflowConfig:
- **consumerConfig**: Redpanda Consumer Config.
- **schemaRegistryConfig**: Redpanda Schema Registry Config.
<Note>
To ingest the topic schema `schemaRegistryURL` must be passed
</Note>
#### Source Configuration - Source Config
The sourceConfig is defined [here](https://github.com/open-metadata/OpenMetadata/blob/main/openmetadata-spec/src/main/resources/json/schema/metadataIngestion/messagingServiceMetadataPipeline.json):

6
openmetadata-docs/content/connectors/messaging/redpanda/cli.md
View File

@ -83,6 +83,12 @@ workflowConfig:
- **consumerConfig**: Redpanda Consumer Config.
- **schemaRegistryConfig**: Redpanda Schema Registry Config.
<Note>
To ingest the topic schema `schemaRegistryURL` must be passed
</Note>
#### Source Configuration - Source Config
The sourceConfig is defined [here](https://github.com/open-metadata/OpenMetadata/blob/main/openmetadata-spec/src/main/resources/json/schema/metadataIngestion/messagingServiceMetadataPipeline.json):

6
openmetadata-docs/content/connectors/messaging/redpanda/index.md
View File

@ -134,6 +134,12 @@ the changes.
- **Consumer Config**: Redpanda Consumer Config.
- **Schema Registry Config**: Redpanda Schema Registry Config.
<Note>
To ingest the topic schema `Schema Registry URL` must be passed
</Note>
### 6. Configure Metadata Ingestion
In this step we will configure the metadata ingestion pipeline,