yujunjun/datahub
2
0
Fork 0
mirror of https://github.com/datahub-project/datahub.git synced 2025-07-25 18:38:55 +00:00
Code Issues Packages Projects Releases Wiki Activity
datahub/docker/kafka-setup
History
david-leifker 637b540fa6
fix(kafka-setup): fix return code check (#6782) 
* fix(kafka-setup): parallelize topic creation
* Remove -setup from docker compose (not services)
2022-12-16 13:39:18 -06:00
..
env
feat(metadata service): Introducing Platform Events (#4477)
2022-03-29 18:32:04 -07:00
Dockerfile
fix(setup): Bump setup images to alpine 3.14 with arch based on machine OS. (#6612)
2022-12-09 09:49:24 -06:00
kafka-setup.sh
fix(kafka-setup): fix return code check (#6782)
2022-12-16 13:39:18 -06:00
README.md
…

README.md

Kafka, Zookeeper and Schema Registry

DataHub uses Kafka as the pub-sub message queue in the backend. Official Confluent Kafka Docker images found in Docker Hub is used without any modification.

Debugging Kafka

You can install kafkacat to consume and produce messaged to Kafka topics. For example, to consume messages on MetadataAuditEvent topic, you can run below command.

kafkacat -b localhost:9092 -t MetadataAuditEvent

However, kafkacat currently doesn't support Avro deserialization at this point, but they have an ongoing work for that.