mirror of https://github.com/datahub-project/datahub.git synced 2025-07-25 02:19:58 +00:00

History

* fix(security): commons-text in frontend

* refactor(restli): set threads based on cpu cores
feat(mce-consumers): hit local restli endpoint

* testing docker build

* Add retry configuration options for entity client

* Kafka debugging

* fix(kafka-setup): parallelize topic creation

* Adjust docker build

* Docker build updates

* WIP

* fix(lint): metadata-ingestion lint

* fix(gradle-docker): fix docker frontend dep

* fix(elastic): fix race condition between gms and mae for index creation

* Revert "fix(elastic): fix race condition between gms and mae for index creation"

This reverts commit 9629d12c3bdb3c0dab87604d409ca4c642c9c6d3.

* fix(test): fix datahub frontend test for clean/test cycle

* fix(test): datahub-frontend missing assets in test

* fix(security): set protobuf lib datahub-upgrade & mce/mae-consumer

* gitingore update

* fix(docker): remove platform on docker base image, set by buildx

* refactor(kafka-producer): update kafka producer tracking/logging

* updates per PR feedback

* Add documentation around mce standalone consumer
Kafka consumer concurrency to follow thread count for restli & sql connection pool

Co-authored-by: leifker <dleifker@gmail.com>
Co-authored-by: Pedro Silva <pedro@acryl.io>

2022-12-26 16:09:08 +00:00

env

feat(gms): Pluggable Authentication & Authorization Framework (#6634 )

2022-12-06 10:22:41 -08:00

Dockerfile

refactor(restli-mce-consumer) (#6744 )

2022-12-26 16:09:08 +00:00

jetty.xml

perf(docker): datahub-gms - add jetty configuration xml (#4435 )

2022-03-30 10:10:47 -07:00

README.md

fix: Replace old repository link with new link (#4446 )

2022-03-18 14:12:19 -07:00

start.sh

feat(gms): Pluggable Authentication & Authorization Framework (#6634 )

2022-12-06 10:22:41 -08:00

README.md

DataHub Generalized Metadata Store (GMS) Docker Image

Refer to DataHub GMS Service to have a quick understanding of the architecture and responsibility of this service for the DataHub.

Other Database Platforms

While GMS defaults to using MySQL as its storage backend, it is possible to switch to any of the database platforms supported by Ebean.

For example, you can run the following command to start a GMS that connects to a PostgreSQL backend.

(cd docker/ && docker-compose -f docker-compose.yml -f docker-compose.postgre.yml -p datahub up)

or a MariaDB backend

(cd docker/ && docker-compose -f docker-compose.yml -f docker-compose.mariadb.yml -p datahub up)