mirror of
https://github.com/datahub-project/datahub.git
synced 2025-09-14 11:41:37 +00:00
92c4a3689e
* add job info as aspect of a dataset * add job urn def., aspect and entity * job entity with upstream and downstream lineage * use job urn in upstream & downstream * add Job entity rest APIs * rest.li api, impl and factory for job entity * code cleanup * use pdl; onboard data process entity * add es index json * fix gradlew build ignored tasks * add a comment about data process info field * fix style warning issues * update content based on PR * checked in generated snapshot json * updated based on PR feedback * update data process data format * updated based on code review feedback * revert back gms & mce-job docker image * delete temp files * update based pr feedback * file name and a typo * format with linkedin style Co-authored-by: Liangjun <liajiang@expediagroup.com>
14 lines
648 B
Docker
14 lines
648 B
Docker
# This "container" is a workaround to pre-create search indices
|
|
FROM jwilder/dockerize:0.6.1
|
|
|
|
RUN apk add --no-cache curl
|
|
|
|
COPY corpuser-index-config.json dataprocess-index-config.json dataset-index-config.json /
|
|
|
|
CMD dockerize \
|
|
-wait http://$ELASTICSEARCH_HOST:$ELASTICSEARCH_PORT \
|
|
-timeout 120s \
|
|
curl -XPUT $ELASTICSEARCH_HOST:$ELASTICSEARCH_PORT/corpuserinfodocument --data @corpuser-index-config.json && \
|
|
curl -XPUT $ELASTICSEARCH_HOST:$ELASTICSEARCH_PORT/dataprocessdocument --data @dataprocess-index-config.json && \
|
|
curl -XPUT $ELASTICSEARCH_HOST:$ELASTICSEARCH_PORT/datasetdocument --data @dataset-index-config.json
|