yujunjun/datahub
2
0
Fork 0
mirror of https://github.com/datahub-project/datahub.git synced 2025-10-17 20:08:22 +00:00
Code Issues Packages Projects Releases Wiki Activity
datahub/docker/ingestion
History
John Plaisted 5f9d967451
fix: ingestion docker image (#2027) 
The environment was not set correctly, so it could not fire kafka events. It (mce-cli) always worked when running outside of docker.

I also added a dev ingestion docker image / script which may be much faster if you've already built locally.

Tested:
1. Cleaned docker volumes and started datahub. Verified it is empty.
2. Built with gradle.
3. Ran ./docker/ingestion/ingestion-dev.sh. Verified data shows in DataHub.
4. Ran step 1 again.
5. Ran ./docker/ingestion/ingestion.sh. Verified data shows in DataHub.
2020-12-02 17:40:12 -08:00
..
env
fix: ingestion docker image (#2027)
2020-12-02 17:40:12 -08:00
docker-compose.dev.yml
fix: ingestion docker image (#2027)
2020-12-02 17:40:12 -08:00
docker-compose.yml
fix: ingestion docker image (#2027)
2020-12-02 17:40:12 -08:00
Dockerfile
fix: ingestion docker image (#2027)
2020-12-02 17:40:12 -08:00
ingestion-dev.sh
fix: ingestion docker image (#2027)
2020-12-02 17:40:12 -08:00
ingestion.sh
feat: Port mce-cli to Java. (#1871)
2020-09-25 14:05:29 -07:00
README.md
feat: Port mce-cli to Java. (#1871)
2020-09-25 14:05:29 -07:00

README.md

DataHub MetadataChangeEvent (MCE) Ingestion Docker Image

Ingests data into GMA using the example ingestion CLI. Recommended to use with quickstart to quickly get a DataHub instance up and running with some fake data.