yujunjun/datahub
2
0
Fork 0
mirror of https://github.com/datahub-project/datahub.git synced 2025-12-09 00:56:30 +00:00
Code Issues Packages Projects Releases Wiki Activity
datahub/docker/kafka-setup
History
abiwill 7bbac5ef4d
feat(kafka-setup): add options for sasl_plaintext (#5385) 
allow sasl_plaintext options using environment variables
2022-07-13 13:47:23 -07:00
..
env
feat(metadata service): Introducing Platform Events (#4477)
2022-03-29 18:32:04 -07:00
Dockerfile
Fix iss #4683 (#4697)
2022-04-19 15:22:49 -07:00
kafka-setup.sh
feat(kafka-setup): add options for sasl_plaintext (#5385)
2022-07-13 13:47:23 -07:00
README.md
…

README.md

Kafka, Zookeeper and Schema Registry

DataHub uses Kafka as the pub-sub message queue in the backend. Official Confluent Kafka Docker images found in Docker Hub is used without any modification.

Debugging Kafka

You can install kafkacat to consume and produce messaged to Kafka topics. For example, to consume messages on MetadataAuditEvent topic, you can run below command.

kafkacat -b localhost:9092 -t MetadataAuditEvent

However, kafkacat currently doesn't support Avro deserialization at this point, but they have an ongoing work for that.