yujunjun/datahub
2
0
Fork 0
mirror of https://github.com/datahub-project/datahub.git synced 2025-07-28 03:49:37 +00:00
Code Issues Packages Projects Releases Wiki Activity
datahub/docker/kafka-setup
History
chen4119 3c32ac7916
fix(kafka-setup): Check if keystore/truststore location env variables are set (#4924) 
* OIDC discovery URL will not have none as auth method

* Fix code style

* fix compilation error

* add keystore/truststore type env variables

* check keystore/truststore location is set

Co-authored-by: Dexter Lee <dexter@acryl.io>
2022-05-16 13:51:19 -07:00
..
env
…
Dockerfile
Fix iss #4683 (#4697)
2022-04-19 15:22:49 -07:00
kafka-setup.sh
fix(kafka-setup): Check if keystore/truststore location env variables are set (#4924)
2022-05-16 13:51:19 -07:00
README.md
…

README.md

Kafka, Zookeeper and Schema Registry

DataHub uses Kafka as the pub-sub message queue in the backend. Official Confluent Kafka Docker images found in Docker Hub is used without any modification.

Debugging Kafka

You can install kafkacat to consume and produce messaged to Kafka topics. For example, to consume messages on MetadataAuditEvent topic, you can run below command.

kafkacat -b localhost:9092 -t MetadataAuditEvent

However, kafkacat currently doesn't support Avro deserialization at this point, but they have an ongoing work for that.