yujunjun/datahub
2
0
Fork 0
mirror of https://github.com/datahub-project/datahub.git synced 2025-08-16 13:16:52 +00:00
Code Issues Packages Projects Releases Wiki Activity

fix(docs): Add documentation on how to connect to custom ES instance. (#3581)

Browse Source
This commit is contained in:
varunbharill 2021-11-16 14:09:40 -08:00 committed by GitHub
parent 9fdcbdabb0
commit 603e6b9f76
No known key found for this signature in database
GPG Key ID: 4AEE18F83AFDEB23
1 changed files with 9 additions and 0 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

9
docs/deploy/aws.md
View File

@ -284,6 +284,15 @@ a different way of creating time based indices.
Run `helm upgrade --install datahub datahub/datahub --values values.yaml` to apply the changes. Run `helm upgrade --install datahub datahub/datahub --values values.yaml` to apply the changes.
**Note:**
If you have a custom setup of elastic search cluster and are deploying through docker, you can modify the configurations in datahub to point to the specific ES instance -
1. If you are using `docker quickstart` you can modify the hostname and port of the ES instance in docker compose quickstart files located [here](../../docker/quickstart/).
1. Once you have modified the quickstart recipes you can run the quickstart command using a specific docker compose file. Sample command for that is - `datahub docker quickstart --quickstart-compose-file docker/quickstart/docker-compose-without-neo4j.quickstart.yml`
2. If you are not using quickstart recipes, you can modify environment variable in GMS to point to the ES instance. The env files for datahub-gms are located [here](../../docker/datahub-gms/env/).
Further, you can find a list of properties supported to work with a custom ES instance [here](../../metadata-service/factories/src/main/java/com/linkedin/gms/factory/common/ElasticsearchSSLContextFactory.java) and [here](../../metadata-service/factories/src/main/java/com/linkedin/gms/factory/common/RestHighLevelClientFactory.java).
A mapping between the property name used in the above two files and the name used in docker/env file can be found [here](../../metadata-service/factories/src/main/resources/application.yml).
### Managed Streaming for Apache Kafka (MSK) ### Managed Streaming for Apache Kafka (MSK)
Provision an MSK cluster that shares the VPC with the kubernetes cluster or has VPC peering set up between the VPC of Provision an MSK cluster that shares the VPC with the kubernetes cluster or has VPC peering set up between the VPC of