yujunjun/datahub
2
0
Fork 0
mirror of https://github.com/datahub-project/datahub.git synced 2025-12-01 21:27:15 +00:00
Code Issues Packages Projects Releases Wiki Activity

docs: points to docker images hosted by linkedin org (#1683)

Browse Source 
As we're now utilize GitHub Actions to build & publish docker images to docker hub under linkedin org
Also allow overriding image tags via DATAHUB_VERSION environment variable
This commit is contained in:
Mars Lan 2020-06-01 09:36:51 -07:00 committed by GitHub
parent 63943a1ca8
commit 920a1774dc
No known key found for this signature in database
GPG Key ID: 4AEE18F83AFDEB23
26 changed files with 49 additions and 49 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

8
contrib/kubernetes/README.md
View File

@ -41,16 +41,16 @@ The following table lists the configuration parameters and its default values
| Key | Type | Default | Description |
|-----|------|---------|-------------|
| datahub-frontend.enabled | bool | `true` | |
| datahub-frontend.image.repository | string | `"keremsahin/datahub-frontend"` | |
| datahub-frontend.image.repository | string | `"linkedin/datahub-frontend"` | |
| datahub-frontend.image.tag | string | `"latest"` | |
| datahub-gms.enabled | bool | `true` | |
| datahub-gms.image.repository | string | `"keremsahin/datahub-gms"` | |
| datahub-gms.image.repository | string | `"linkedin/datahub-gms"` | |
| datahub-gms.image.tag | string | `"latest"` | |
| datahub-mae-consumer.enabled | bool | `true` | |
| datahub-mae-consumer.image.repository | string | `"keremsahin/datahub-mae-consumer"` | |
| datahub-mae-consumer.image.repository | string | `"linkedin/datahub-mae-consumer"` | |
| datahub-mae-consumer.image.tag | string | `"latest"` | |
| datahub-mce-consumer.enabled | bool | `true` | |
| datahub-mce-consumer.image.repository | string | `"keremsahin/datahub-mce-consumer"` | |
| datahub-mce-consumer.image.repository | string | `"linkedin/datahub-mce-consumer"` | |
| datahub-mce-consumer.image.tag | string | `"latest"` | |
| global.datahub.appVersion | string | `"1.0"` | |
| global.datahub.gms.host | string | `"datahub-gms-deployment"` | |

8
contrib/kubernetes/datahub/README.md
View File

@ -18,16 +18,16 @@ Current chart version is `0.0.1`
| Key | Type | Default | Description |
|-----|------|---------|-------------|
| datahub-frontend.enabled | bool | `true` | |
| datahub-frontend.image.repository | string | `"keremsahin/datahub-frontend"` | |
| datahub-frontend.image.repository | string | `"linkedin/datahub-frontend"` | |
| datahub-frontend.image.tag | string | `"latest"` | |
| datahub-gms.enabled | bool | `true` | |
| datahub-gms.image.repository | string | `"keremsahin/datahub-gms"` | |
| datahub-gms.image.repository | string | `"linkedin/datahub-gms"` | |
| datahub-gms.image.tag | string | `"latest"` | |
| datahub-mae-consumer.enabled | bool | `true` | |
| datahub-mae-consumer.image.repository | string | `"keremsahin/datahub-mae-consumer"` | |
| datahub-mae-consumer.image.repository | string | `"linkedin/datahub-mae-consumer"` | |
| datahub-mae-consumer.image.tag | string | `"latest"` | |
| datahub-mce-consumer.enabled | bool | `true` | |
| datahub-mce-consumer.image.repository | string | `"keremsahin/datahub-mce-consumer"` | |
| datahub-mce-consumer.image.repository | string | `"linkedin/datahub-mce-consumer"` | |
| datahub-mce-consumer.image.tag | string | `"latest"` | |
| global.datahub.appVersion | string | `"1.0"` | |
| global.datahub.gms.host | string | `"datahub-gms-deployment"` | |

2
contrib/kubernetes/datahub/charts/datahub-frontend/README.md
View File

@ -15,7 +15,7 @@ Current chart version is `0.1.0`
| global.datahub.gms.port | string | `"8080"` | |
| global.datahub.gms.secret | string | `"YouKnowNothing"` | |
| image.pullPolicy | string | `"IfNotPresent"` | |
| image.repository | string | `"keremsahin/datahub-frontend"` | |
| image.repository | string | `"linkedin/datahub-frontend"` | |
| image.tag | string | `"latest"` | |
| imagePullSecrets | list | `[]` | |
| ingress.annotations | object | `{}` | |

2
contrib/kubernetes/datahub/charts/datahub-frontend/values.yaml
View File

@ -5,7 +5,7 @@
replicaCount: 1
image:
repository: keremsahin/datahub-frontend
repository: linkedin/datahub-frontend
tag: "latest"
pullPolicy: IfNotPresent

2
contrib/kubernetes/datahub/charts/datahub-gms/README.md
View File

@ -29,7 +29,7 @@ Current chart version is `0.1.0`
| global.sql.datasource.url | string | `"jdbc:mysql://192.168.0.104:3306/datahub?verifyServerCertificate=false\u0026useSSL=true"` | |
| global.sql.datasource.username | string | `"datahub"` | |
| image.pullPolicy | string | `"IfNotPresent"` | |
| image.repository | string | `"keremsahin/datahub-gms"` | |
| image.repository | string | `"linkedin/datahub-gms"` | |
| image.tag | string | `"latest"` | |
| imagePullSecrets | list | `[]` | |
| ingress.annotations | object | `{}` | |

2
contrib/kubernetes/datahub/charts/datahub-gms/values.yaml
View File

@ -5,7 +5,7 @@
replicaCount: 1
image:
repository: keremsahin/datahub-gms
repository: linkedin/datahub-gms
pullPolicy: IfNotPresent
tag: latest

2
contrib/kubernetes/datahub/charts/datahub-mae-consumer/README.md
View File

@ -16,7 +16,7 @@ Current chart version is `0.1.0`
| global.hostAliases[0].hostnames[3] | string | `"neo4j"` | |
| global.hostAliases[0].ip | string | `"192.168.0.104"` | |
| image.pullPolicy | string | `"IfNotPresent"` | |
| image.repository | string | `"keremsahin/datahub-mae-consumer"` | |
| image.repository | string | `"linkedin/datahub-mae-consumer"` | |
| image.tag | string | `"latest"` | |
| imagePullSecrets | list | `[]` | |
| ingress.annotations | object | `{}` | |

2
contrib/kubernetes/datahub/charts/datahub-mae-consumer/values.yaml
View File

@ -5,7 +5,7 @@
replicaCount: 1
image:
repository: keremsahin/datahub-mae-consumer
repository: linkedin/datahub-mae-consumer
pullPolicy: IfNotPresent
tag: latest

2
contrib/kubernetes/datahub/charts/datahub-mce-consumer/README.md
View File

@ -19,7 +19,7 @@ Current chart version is `0.1.0`
| global.hostAliases[0].hostnames[3] | string | `"neo4j"` | |
| global.hostAliases[0].ip | string | `"192.168.0.104"` | |
| image.pullPolicy | string | `"IfNotPresent"` | |
| image.repository | string | `"keremsahin/datahub-mce-consumer"` | |
| image.repository | string | `"linkedin/datahub-mce-consumer"` | |
| image.tag | string | `"latest"` | |
| imagePullSecrets | list | `[]` | |
| ingress.annotations | object | `{}` | |

2
contrib/kubernetes/datahub/charts/datahub-mce-consumer/values.yaml
View File

@ -5,7 +5,7 @@
replicaCount: 1
image:
repository: keremsahin/datahub-mce-consumer
repository: linkedin/datahub-mce-consumer
pullPolicy: IfNotPresent
tag: latest

8
contrib/kubernetes/datahub/values.yaml
View File

@ -5,25 +5,25 @@
datahub-gms:
enabled: true
image:
repository: keremsahin/datahub-gms
repository: linkedin/datahub-gms
tag: "latest"
datahub-frontend:
enabled: true
image:
repository: keremsahin/datahub-frontend
repository: linkedin/datahub-frontend
tag: "latest"
datahub-mae-consumer:
enabled: true
image:
repository: keremsahin/datahub-mae-consumer
repository: linkedin/datahub-mae-consumer
tag: "latest"
datahub-mce-consumer:
enabled: true
image:
repository: keremsahin/datahub-mce-consumer
repository: linkedin/datahub-mce-consumer
tag: "latest"
global:

2
contrib/kubernetes/yaml/datahub-frontend-deployment.yaml
View File

@ -16,7 +16,7 @@ spec:
spec:
containers:
- name: datahub-frontend
image: keremsahin/datahub-frontend:latest
image: linkedin/datahub-frontend:latest
ports:
- containerPort: 9001
env:

2
contrib/kubernetes/yaml/datahub-gms-deployment.yaml
View File

@ -16,7 +16,7 @@ spec:
spec:
containers:
- name: datahub-gms
image: keremsahin/datahub-gms:latest
image: linkedin/datahub-gms:latest
ports:
- containerPort: 8080
command: ["/bin/sh", "-c" ,"java -jar jetty-runner-9.4.20.v20190813.jar gms.war"]

2
contrib/kubernetes/yaml/datahub-mae-consumer-deployment.yaml
View File

@ -16,7 +16,7 @@ spec:
spec:
containers:
- name: datahub-mae-consumer
image: keremsahin/datahub-mae-consumer:latest
image: linkedin/datahub-mae-consumer:latest
command: ["/bin/sh", "-c" ,"./mae-consumer-job/bin/mae-consumer-job"]
env:
- name: KAFKA_BOOTSTRAP_SERVER

2
contrib/kubernetes/yaml/datahub-mce-consumer-deployment.yaml
View File

@ -16,7 +16,7 @@ spec:
spec:
containers:
- name: datahub-mce-consumer
image: keremsahin/datahub-mce-consumer:latest
image: linkedin/datahub-mce-consumer:latest
command: ["/bin/sh", "-c" ,"./mce-consumer-job/bin/mce-consumer-job"]
env:
- name: KAFKA_BOOTSTRAP_SERVER

10
docker/README.md
View File

@ -1,11 +1,11 @@
# Docker Images
The easiest way to bring up and test DataHub is using DataHub [Docker](https://www.docker.com) images
which are continuously deployed to [Docker Hub](https://hub.docker.com/u/keremsahin) with every commit to repository.
which are continuously deployed to [Docker Hub](https://hub.docker.com/u/linkedin) with every commit to repository.
* [**datahub-gms**](gms): [![Docker Cloud Build Status](https://img.shields.io/docker/cloud/build/keremsahin/datahub-gms)](https://cloud.docker.com/repository/docker/keremsahin/datahub-gms/)
* [**datahub-frontend**](frontend): [![Docker Cloud Build Status](https://img.shields.io/docker/cloud/build/keremsahin/datahub-frontend)](https://cloud.docker.com/repository/docker/keremsahin/datahub-frontend/)
* [**datahub-mce-consumer**](mce-consumer): [![Docker Cloud Build Status](https://img.shields.io/docker/cloud/build/keremsahin/datahub-mce-consumer)](https://cloud.docker.com/repository/docker/keremsahin/datahub-mce-consumer/)
* [**datahub-mae-consumer**](mae-consumer): [![Docker Cloud Build Status](https://img.shields.io/docker/cloud/build/keremsahin/datahub-mae-consumer)](https://cloud.docker.com/repository/docker/keremsahin/datahub-mae-consumer/)
* [linkedin/datahub-gms](https://cloud.docker.com/repository/docker/linkedin/datahub-gms/)
* [linkedin/datahub-frontend](https://cloud.docker.com/repository/docker/linkedin/datahub-frontend/)
* [linkedin/datahub-mae-consumer](https://cloud.docker.com/repository/docker/linkedin/datahub-mae-consumer/)
* [linkedin/datahub-mce-consumer](https://cloud.docker.com/repository/docker/linkedin/datahub-mce-consumer/)
Above Docker images are created for DataHub specific use. You can check subdirectories to check how those images are
generated via [Dockerbuild](https://docs.docker.com/engine/reference/commandline/build/) files or

4
docker/frontend/README.md
View File

@ -1,12 +1,12 @@
# DataHub Frontend Docker Image
[![Docker Cloud Build Status](https://img.shields.io/docker/cloud/build/keremsahin/datahub-frontend)](https://cloud.docker.com/repository/docker/keremsahin/datahub-frontend/)
[![datahub-frontend docker](https://github.com/linkedin/datahub/workflows/datahub-frontend%20docker/badge.svg)](https://github.com/linkedin/datahub/actions?query=workflow%3A%22datahub-frontend+docker%22)
Refer to [DataHub Frontend Service](../../datahub-frontend) to have a quick understanding of the architecture and
responsibility of this service for the DataHub.
## Build
```
docker image build -t keremsahin/datahub-frontend -f docker/frontend/Dockerfile .
docker image build -t linkedin/datahub-frontend -f docker/frontend/Dockerfile .
```
This command will build and deploy the image in your local store.

2
docker/frontend/docker-compose.yml
View File

@ -2,7 +2,7 @@
version: '3.5'
services:
datahub-frontend:
image: keremsahin/datahub-frontend:latest
image: linkedin/datahub-frontend:${DATAHUB_VERSION:-latest}
hostname: datahub-frontend
container_name: datahub-frontend
ports:

4
docker/gms/README.md
View File

@ -1,12 +1,12 @@
# DataHub Generalized Metadata Store (GMS) Docker Image
[![Docker Cloud Build Status](https://img.shields.io/docker/cloud/build/keremsahin/datahub-gms)](https://cloud.docker.com/repository/docker/keremsahin/datahub-gms/)
[![datahub-gms docker](https://github.com/linkedin/datahub/workflows/datahub-gms%20docker/badge.svg)](https://github.com/linkedin/datahub/actions?query=workflow%3A%22datahub-gms+docker%22)
Refer to [DataHub GMS Service](../../gms) to have a quick understanding of the architecture and
responsibility of this service for the DataHub.
## Build
```
docker image build -t keremsahin/datahub-gms -f docker/gms/Dockerfile .
docker image build -t linkedin/datahub-gms -f docker/gms/Dockerfile .
```
This command will build and deploy the image in your local store.

2
docker/gms/docker-compose.yml
View File

@ -2,7 +2,7 @@
version: '3.5'
services:
datahub-gms:
image: keremsahin/datahub-gms:latest
image: linkedin/datahub-gms:${DATAHUB_VERSION:-latest}
hostname: datahub-gms
container_name: datahub-gms
ports:

4
docker/mae-consumer/README.md
View File

@ -1,12 +1,12 @@
# DataHub MetadataAuditEvent (MAE) Consumer Docker Image
[![Docker Cloud Build Status](https://img.shields.io/docker/cloud/build/keremsahin/datahub-mae-consumer)](https://cloud.docker.com/repository/docker/keremsahin/datahub-mae-consumer/)
[![datahub-mae-consumer docker](https://github.com/linkedin/datahub/workflows/datahub-mae-consumer%20docker/badge.svg)](https://github.com/linkedin/datahub/actions?query=workflow%3A%22datahub-mae-consumer+docker%22)
Refer to [DataHub MAE Consumer Job](../../metadata-jobs/mae-consumer-job) to have a quick understanding of the architecture and
responsibility of this service for the DataHub.
## Build
```
docker image build -t keremsahin/datahub-mae-consumer -f docker/mae-consumer/Dockerfile .
docker image build -t linkedin/datahub-mae-consumer -f docker/mae-consumer/Dockerfile .
```
This command will build and deploy the image in your local store.

2
docker/mae-consumer/docker-compose.yml
View File

@ -2,7 +2,7 @@
version: '3.5'
services:
datahub-mae-consumer:
image: keremsahin/datahub-mae-consumer:latest
image: linkedin/datahub-mae-consumer:${DATAHUB_VERSION:-latest}
hostname: datahub-mae-consumer
container_name: datahub-mae-consumer
ports:

4
docker/mce-consumer/README.md
View File

@ -1,12 +1,12 @@
# DataHub MetadataChangeEvent (MCE) Consumer Docker Image
[![Docker Cloud Build Status](https://img.shields.io/docker/cloud/build/keremsahin/datahub-mce-consumer)](https://cloud.docker.com/repository/docker/keremsahin/datahub-mce-consumer/)
[![datahub-mce-consumer docker](https://github.com/linkedin/datahub/workflows/datahub-mce-consumer%20docker/badge.svg)](https://github.com/linkedin/datahub/actions?query=workflow%3A%22datahub-mce-consumer+docker%22)
Refer to [DataHub MCE Consumer Job](../../metadata-jobs/mce-consumer-job) to have a quick understanding of the architecture and
responsibility of this service for the DataHub.
## Build
```
docker image build -t keremsahin/datahub-mce-consumer -f docker/mce-consumer/Dockerfile .
docker image build -t linkedin/datahub-mce-consumer -f docker/mce-consumer/Dockerfile .
```
This command will build and deploy the image in your local store.

2
docker/mce-consumer/docker-compose.yml
View File

@ -2,7 +2,7 @@
version: '3.5'
services:
datahub-mce-consumer:
image: keremsahin/datahub-mce-consumer:latest
image: linkedin/datahub-mce-consumer:${DATAHUB_VERSION:-latest}
hostname: datahub-mce-consumer
container_name: datahub-mce-consumer
ports:

8
docker/quickstart/docker-compose.yml
View File

@ -176,7 +176,7 @@ services:
- ELASTICSEARCH_PORT=9200
datahub-gms:
image: keremsahin/datahub-gms:latest
image: linkedin/datahub-gms:${DATAHUB_VERSION:-latest}
hostname: datahub-gms
container_name: datahub-gms
ports:
@ -205,7 +205,7 @@ services:
java -jar jetty-runner-9.4.20.v20190813.jar gms.war'"
datahub-frontend:
image: keremsahin/datahub-frontend:latest
image: linkedin/datahub-frontend:${DATAHUB_VERSION:-latest}
hostname: datahub-frontend
container_name: datahub-frontend
ports:
@ -220,7 +220,7 @@ services:
- datahub-gms
datahub-mae-consumer:
image: keremsahin/datahub-mae-consumer:latest
image: linkedin/datahub-mae-consumer:${DATAHUB_VERSION:-latest}
hostname: datahub-mae-consumer
container_name: datahub-mae-consumer
ports:
@ -242,7 +242,7 @@ services:
dockerize -wait http://neo4j:7474 -timeout 240s && java -jar mae-consumer-job.jar'"
datahub-mce-consumer:
image: keremsahin/datahub-mce-consumer:latest
image: linkedin/datahub-mce-consumer:${DATAHUB_VERSION:-latest}
hostname: datahub-mce-consumer
container_name: datahub-mce-consumer
ports:

8
docs/debugging.md
View File

@ -5,10 +5,10 @@ You can list all Docker containers in your local by running `docker container ls
```
CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES
979830a342ce keremsahin/datahub-mce-consumer:latest "bash -c 'while ping…" 10 hours ago Up 10 hours datahub-mce-consumer
3abfc72e205d keremsahin/datahub-frontend:latest "datahub-frontend/bi…" 10 hours ago Up 10 hours 0.0.0.0:9001->9001/tcp datahub-frontend
50b2308a8efd keremsahin/datahub-mae-consumer:latest "bash -c 'while ping…" 10 hours ago Up 10 hours datahub-mae-consumer
4d6b03d77113 keremsahin/datahub-gms:latest "bash -c 'dockerize …" 10 hours ago Up 10 hours 0.0.0.0:8080->8080/tcp datahub-gms
979830a342ce linkedin/datahub-mce-consumer:latest "bash -c 'while ping…" 10 hours ago Up 10 hours datahub-mce-consumer
3abfc72e205d linkedin/datahub-frontend:latest "datahub-frontend/bi…" 10 hours ago Up 10 hours 0.0.0.0:9001->9001/tcp datahub-frontend
50b2308a8efd linkedin/datahub-mae-consumer:latest "bash -c 'while ping…" 10 hours ago Up 10 hours datahub-mae-consumer
4d6b03d77113 linkedin/datahub-gms:latest "bash -c 'dockerize …" 10 hours ago Up 10 hours 0.0.0.0:8080->8080/tcp datahub-gms
c267c287a235 landoop/schema-registry-ui:latest "/run.sh" 10 hours ago Up 10 hours 0.0.0.0:8000->8000/tcp schema-registry-ui
4b38899cc29a confluentinc/cp-schema-registry:5.2.1 "/etc/confluent/dock…" 10 hours ago Up 10 hours 0.0.0.0:8081->8081/tcp schema-registry
37c29781a263 confluentinc/cp-kafka:5.2.1 "/etc/confluent/dock…" 10 hours ago Up 10 hours 0.0.0.0:9092->9092/tcp, 0.0.0.0:29092->29092/tcp broker