yujunjun/OpenMetadata
1
0
Fork 0
mirror of https://github.com/open-metadata/OpenMetadata.git synced 2025-08-23 16:38:17 +00:00
Code Issues Packages Projects Releases Wiki Activity

Doc: Update Kafka troubleshooting section (#11067)

Browse Source
This commit is contained in:
Nahuel 2023-04-14 13:35:58 +02:00 committed by GitHub
parent 5152db488d
commit c596ad2006
No known key found for this signature in database
GPG Key ID: 4AEE18F83AFDEB23
2 changed files with 24 additions and 3 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

10
ingestion/src/metadata/examples/workflows/kafka.yaml
View File

@ -6,8 +6,14 @@ source:
type: Kafka type: Kafka
bootstrapServers: localhost:9092 bootstrapServers: localhost:9092
schemaRegistryURL: http://localhost:8081 schemaRegistryURL: http://localhost:8081
consumerConfig: {} consumerConfig:
schemaRegistryConfig: {} # example of consume config, for more info about accepted values visit:
# https://github.com/confluentinc/librdkafka/blob/master/CONFIGURATION.md
"ssl.truststore.password": "password"
schemaRegistryConfig:
# example of scema registry config, for more info about accepted values visit:
# https://docs.confluent.io/5.5.1/clients/confluent-kafka-python/index.html#confluent_kafka.schema_registry.SchemaRegistryClient
"basic.auth.user.info": "username:password"
sourceConfig: sourceConfig:
config: config:
type: MessagingMetadata type: MessagingMetadata

17
openmetadata-docs/content/connectors/messaging/kafka/troubleshooting.md
View File

@ -18,4 +18,19 @@ The image below shows what the configuration of a local Kafka server with a secu
src="/images/openmetadata/connectors/kafka/kafka-config.png" src="/images/openmetadata/connectors/kafka/kafka-config.png"
alt="Configuration of a local Kafka server with a secured schema registry" alt="Configuration of a local Kafka server with a secured schema registry"
caption="Configuration of a local Kafka server with a secured schema registry" caption="Configuration of a local Kafka server with a secured schema registry"
/> />
In case you are performing the ingestion through the CLI with a YAML file, the service connection config should look
like this:
```yaml
serviceConnection:
config:
type: Kafka
bootstrapServers: localhost:9092
schemaRegistryURL: http://localhost:8081
consumerConfig:
"ssl.truststore.password": "password"
schemaRegistryConfig:
"basic.auth.user.info": "username:password"
```