mirror of
https://github.com/datahub-project/datahub.git
synced 2025-11-01 03:09:12 +00:00
5f9d967451
The environment was not set correctly, so it could not fire kafka events. It (mce-cli) always worked when running outside of docker. I also added a dev ingestion docker image / script which may be much faster if you've already built locally. Tested: 1. Cleaned docker volumes and started datahub. Verified it is empty. 2. Built with gradle. 3. Ran ./docker/ingestion/ingestion-dev.sh. Verified data shows in DataHub. 4. Ran step 1 again. 5. Ran ./docker/ingestion/ingestion.sh. Verified data shows in DataHub.
19 lines
818 B
Docker
19 lines
818 B
Docker
# Defining environment
|
|
ARG APP_ENV=prod
|
|
|
|
FROM openjdk:8-jre-alpine as base
|
|
|
|
FROM openjdk:8 as prod-build
|
|
COPY . datahub-src
|
|
RUN cd datahub-src && ./gradlew :metadata-ingestion-examples:mce-cli:build
|
|
|
|
FROM base as prod-install
|
|
COPY --from=prod-build datahub-src/metadata-ingestion-examples/mce-cli/build/libs/mce-cli.jar /datahub/ingestion/bin/mce-cli.jar
|
|
COPY --from=prod-build datahub-src/metadata-ingestion-examples/mce-cli/example-bootstrap.json /datahub/ingestion/example-bootstrap.json
|
|
|
|
FROM base as dev-install
|
|
# Dummy stage for development. Assumes code is built on your machine and mounted to this image.
|
|
# See this excellent thread https://github.com/docker/cli/issues/1134
|
|
|
|
FROM ${APP_ENV}-install as final
|
|
CMD java -jar /datahub/ingestion/bin/mce-cli.jar -m produce /datahub/ingestion/example-bootstrap.json |