2023-04-17 16:45:47 +02:00 
										
									 
								 
							 
							
								
							 
							
								 
							
							
								---
							 
						 
					
						
							
								
							 
							
								
							 
							
								 
							
							
								title: Kafka Connector Troubleshooting
							 
						 
					
						
							
								
									
										
										
										
											2023-05-04 12:37:18 -07:00 
										
									 
								 
							 
							
								
									
										 
								
							 
							
								 
							
							
								slug: /connectors/messaging/kafka/troubleshooting
							 
						 
					
						
							
								
									
										
										
										
											2023-04-17 16:45:47 +02:00 
										
									 
								 
							 
							
								
							 
							
								 
							
							
								---
							 
						 
					
						
							
								
							 
							
								
							 
							
								 
							
							
								
							 
						 
					
						
							
								
							 
							
								
							 
							
								 
							
							
								# Troubleshooting
  
						 
					
						
							
								
							 
							
								
							 
							
								 
							
							
								
							 
						 
					
						
							
								
							 
							
								
							 
							
								 
							
							
								## Consumer and schema registry config
  
						 
					
						
							
								
							 
							
								
							 
							
								 
							
							
								
							 
						 
					
						
							
								
									
										
										
										
											2023-04-21 09:11:07 +02:00 
										
									 
								 
							 
							
								
									
										 
								
							 
							
								 
							
							
								When configuring the Kafka connector, we could need to pass extra parameters to the consumer or the schema registry to
							 
						 
					
						
							
								
							 
							
								
							 
							
								 
							
							
								be able to connect. The accepted values for the consumer can be found in the following
							 
						 
					
						
							
								
							 
							
								
							 
							
								 
							
							
								[link ](https://github.com/edenhill/librdkafka/blob/master/CONFIGURATION.md ), while the ones optional for
							 
						 
					
						
							
								
									
										
										
										
											2023-04-17 16:45:47 +02:00 
										
									 
								 
							 
							
								
							 
							
								 
							
							
								the schema registry are [here ](https://docs.confluent.io/5.5.1/clients/confluent-kafka-python/index.html#confluent_kafka.schema_registry.SchemaRegistryClient ).
							 
						 
					
						
							
								
							 
							
								
							 
							
								 
							
							
								
							 
						 
					
						
							
								
							 
							
								
							 
							
								 
							
							
								The image below shows what the configuration of a local Kafka server with a secured schema registry would look like:
							 
						 
					
						
							
								
							 
							
								
							 
							
								 
							
							
								
							 
						 
					
						
							
								
									
										
										
										
											2023-04-21 09:11:07 +02:00 
										
									 
								 
							 
							
								
									
										 
								
							 
							
								 
							
							
								{% image
							 
						 
					
						
							
								
									
										
										
										
											2023-04-24 16:44:31 +02:00 
										
									 
								 
							 
							
								
									
										 
								
							 
							
								 
							
							
								src="/images/v1.0.0/connectors/kafka/kafka-config.png"
							 
						 
					
						
							
								
									
										
										
										
											2023-04-17 16:45:47 +02:00 
										
									 
								 
							 
							
								
							 
							
								 
							
							
								alt="Configuration of a local Kafka server with a secured schema registry"
							 
						 
					
						
							
								
									
										
										
										
											2023-04-21 09:11:07 +02:00 
										
									 
								 
							 
							
								
									
										 
								
							 
							
								 
							
							
								caption="Configuration of a local Kafka server with a secured schema registry" /%}
							 
						 
					
						
							
								
							 
							
								
							 
							
								 
							
							
								
							 
						 
					
						
							
								
							 
							
								
							 
							
								 
							
							
								In case you are performing the ingestion through the CLI with a YAML file, the service connection config should look
							 
						 
					
						
							
								
							 
							
								
							 
							
								 
							
							
								like this:
							 
						 
					
						
							
								
							 
							
								
							 
							
								 
							
							
								
							 
						 
					
						
							
								
							 
							
								
							 
							
								 
							
							
								```yaml
							 
						 
					
						
							
								
							 
							
								
							 
							
								 
							
							
								  serviceConnection:
							 
						 
					
						
							
								
							 
							
								
							 
							
								 
							
							
								    config:
							 
						 
					
						
							
								
							 
							
								
							 
							
								 
							
							
								      type: Kafka
							 
						 
					
						
							
								
							 
							
								
							 
							
								 
							
							
								      bootstrapServers: localhost:9092
							 
						 
					
						
							
								
							 
							
								
							 
							
								 
							
							
								      schemaRegistryURL: http://localhost:8081
							 
						 
					
						
							
								
							 
							
								
							 
							
								 
							
							
								      consumerConfig:
							 
						 
					
						
							
								
							 
							
								
							 
							
								 
							
							
								        "ssl.truststore.password": "password"
							 
						 
					
						
							
								
							 
							
								
							 
							
								 
							
							
								      schemaRegistryConfig:
							 
						 
					
						
							
								
							 
							
								
							 
							
								 
							
							
								        "basic.auth.user.info": "username:password"
							 
						 
					
						
							
								
							 
							
								
							 
							
								 
							
							
								```