[DOCS] Update Troublesbooting docs for SSL to new env and keys (#14654)

* Update Troublesbooting docs for SSL to new env and keys in openmetadata.yaml

* Update PipelineServiceClientConfig
This commit is contained in:
Mohit Yadav 2024-01-09 21:24:56 +05:30 committed by GitHub
parent 3ed8a4223f
commit dbd9f1381a
No known key found for this signature in database
GPG Key ID: 4AEE18F83AFDEB23
8 changed files with 88 additions and 37 deletions

View File

@ -62,11 +62,23 @@ airflowConfiguration:
**After 0.12.1**
```yaml
airflowConfiguration:
apiEndpoint: ${AIRFLOW_HOST:-http://localhost:8080}
username: ${AIRFLOW_USERNAME:-admin}
password: ${AIRFLOW_PASSWORD:-admin}
pipelineServiceClientConfiguration:
apiEndpoint: ${PIPELINE_SERVICE_CLIENT_ENDPOINT:-http://localhost:8080}
metadataApiEndpoint: ${SERVER_HOST_API_URL:-http://localhost:8585/api}
ingestionIpInfoEnabled: ${PIPELINE_SERVICE_IP_INFO_ENABLED:-false}
hostIp: ${PIPELINE_SERVICE_CLIENT_HOST_IP:-""}
verifySSL: ${PIPELINE_SERVICE_CLIENT_VERIFY_SSL:-"no-ssl"} # Possible values are "no-ssl", "ignore", "validate"
sslConfig:
certificatePath: ${PIPELINE_SERVICE_CLIENT_SSL_CERT_PATH:-""} # Local path for the Pipeline Service Client
# Default required parameters for Airflow as Pipeline Service Client
parameters:
username: ${AIRFLOW_USERNAME:-admin}
password: ${AIRFLOW_PASSWORD:-admin}
timeout: ${AIRFLOW_TIMEOUT:-10}
# If we need to use SSL to reach Airflow
truststorePath: ${AIRFLOW_TRUST_STORE_PATH:-""}
truststorePassword: ${AIRFLOW_TRUST_STORE_PASSWORD:-""}
```
{% note %}

View File

@ -57,8 +57,8 @@ We specify which public certificate must be used to validate the OM server conne
- In **docker**:
```yaml
AIRFLOW_VERIFY_SSL=validate
AIRFLOW_SSL_CERT_PATH=/path/to/certificate/in/airflow
PIPELINE_SERVICE_CLIENT_VERIFY_SSL=validate
PIPELINE_SERVICE_CLIENT_SSL_CERT_PATH=/path/to/certificate/in/airflow
```
- In **bare metal**:
@ -66,7 +66,7 @@ AIRFLOW_SSL_CERT_PATH=/path/to/certificate/in/airflow
Edit the `conf/openmetadata.yaml` file:
```yaml
airflowConfiguration:
pipelineServiceClientConfiguration:
verifySSL: "validate"
sslConfig:
validate:
@ -91,7 +91,7 @@ When doing any call to the secured OM server, the certificate validation will be
- In **docker**:
```yaml
AIRFLOW_VERIFY_SSL=ignore
PIPELINE_SERVICE_CLIENT_VERIFY_SSL=ignore
```
- In **bare metal**:
@ -99,7 +99,7 @@ AIRFLOW_VERIFY_SSL=ignore
Edit the `conf/openmetadata.yaml` file:
```yaml
airflowConfiguration:
pipelineServiceClientConfiguration:
verifySSL: "ignore"
```

View File

@ -57,8 +57,8 @@ We specify which public certificate must be used to validate the OM server conne
- In **docker**:
```yaml
AIRFLOW_VERIFY_SSL=validate
AIRFLOW_SSL_CERT_PATH=/path/to/certificate/in/airflow
PIPELINE_SERVICE_CLIENT_VERIFY_SSL=validate
PIPELINE_SERVICE_CLIENT_SSL_CERT_PATH=/path/to/certificate/in/airflow
```
- In **bare metal**:
@ -66,7 +66,7 @@ AIRFLOW_SSL_CERT_PATH=/path/to/certificate/in/airflow
Edit the `conf/openmetadata.yaml` file:
```yaml
airflowConfiguration:
pipelineServiceClientConfiguration:
verifySSL: "validate"
sslConfig:
validate:
@ -92,7 +92,7 @@ When doing any call to the secured OM server, the certificate validation will be
- In **docker**:
```yaml
AIRFLOW_VERIFY_SSL=ignore
PIPELINE_SERVICE_CLIENT_VERIFY_SSL=ignore
```
- In **bare metal**:
@ -100,7 +100,7 @@ AIRFLOW_VERIFY_SSL=ignore
Edit the `conf/openmetadata.yaml` file:
```yaml
airflowConfiguration:
pipelineServiceClientConfiguration:
verifySSL: "ignore"
```

View File

@ -59,11 +59,24 @@ airflowConfiguration:
**After 0.12.1**
```yaml
airflowConfiguration:
apiEndpoint: ${AIRFLOW_HOST:-http://localhost:8080}
username: ${AIRFLOW_USERNAME:-admin}
password: ${AIRFLOW_PASSWORD:-admin}
pipelineServiceClientConfiguration:
apiEndpoint: ${PIPELINE_SERVICE_CLIENT_ENDPOINT:-http://localhost:8080}
metadataApiEndpoint: ${SERVER_HOST_API_URL:-http://localhost:8585/api}
ingestionIpInfoEnabled: ${PIPELINE_SERVICE_IP_INFO_ENABLED:-false}
hostIp: ${PIPELINE_SERVICE_CLIENT_HOST_IP:-""}
healthCheckInterval: ${PIPELINE_SERVICE_CLIENT_HEALTH_CHECK_INTERVAL:-300}
verifySSL: ${PIPELINE_SERVICE_CLIENT_VERIFY_SSL:-"no-ssl"} # Possible values are "no-ssl", "ignore", "validate"
sslConfig:
certificatePath: ${PIPELINE_SERVICE_CLIENT_SSL_CERT_PATH:-""} # Local path for the Pipeline Service Client
# Default required parameters for Airflow as Pipeline Service Client
parameters:
username: ${AIRFLOW_USERNAME:-admin}
password: ${AIRFLOW_PASSWORD:-admin}
timeout: ${AIRFLOW_TIMEOUT:-10}
# If we need to use SSL to reach Airflow
truststorePath: ${AIRFLOW_TRUST_STORE_PATH:-""}
truststorePassword: ${AIRFLOW_TRUST_STORE_PASSWORD:-""}
```
**Note:** Follow [this](/how-to-guides/quick-start-guide-for-admins/bots) guide to configure the `ingestion-bot` credentials for

View File

@ -57,8 +57,8 @@ We specify which public certificate must be used to validate the OM server conne
- In **docker**:
```yaml
AIRFLOW_VERIFY_SSL=validate
AIRFLOW_SSL_CERT_PATH=/path/to/certificate/in/airflow
PIPELINE_SERVICE_CLIENT_VERIFY_SSL=validate
PIPELINE_SERVICE_CLIENT_SSL_CERT_PATH=/path/to/certificate/in/airflow
```
- In **bare metal**:
@ -66,7 +66,7 @@ AIRFLOW_SSL_CERT_PATH=/path/to/certificate/in/airflow
Edit the `conf/openmetadata.yaml` file:
```yaml
airflowConfiguration:
pipelineServiceClientConfiguration:
verifySSL: "validate"
sslConfig:
validate:
@ -92,7 +92,7 @@ When doing any call to the secured OM server, the certificate validation will be
- In **docker**:
```yaml
AIRFLOW_VERIFY_SSL=ignore
PIPELINE_SERVICE_CLIENT_VERIFY_SSL=ignore
```
- In **bare metal**:
@ -100,7 +100,7 @@ AIRFLOW_VERIFY_SSL=ignore
Edit the `conf/openmetadata.yaml` file:
```yaml
airflowConfiguration:
pipelineServiceClientConfiguration:
verifySSL: "ignore"
```

View File

@ -42,7 +42,7 @@ Finally, update the Airflow information:
**Before 0.12.1**
```yaml
airflowConfiguration:
pipelineServiceClientConfiguration:
apiEndpoint: ${AIRFLOW_HOST:-http://localhost:8080}
username: ${AIRFLOW_USERNAME:-admin}
password: ${AIRFLOW_PASSWORD:-admin}
@ -60,11 +60,24 @@ airflowConfiguration:
**After 0.12.1**
```yaml
airflowConfiguration:
apiEndpoint: ${AIRFLOW_HOST:-http://localhost:8080}
username: ${AIRFLOW_USERNAME:-admin}
password: ${AIRFLOW_PASSWORD:-admin}
pipelineServiceClientConfiguration:
apiEndpoint: ${PIPELINE_SERVICE_CLIENT_ENDPOINT:-http://localhost:8080}
metadataApiEndpoint: ${SERVER_HOST_API_URL:-http://localhost:8585/api}
ingestionIpInfoEnabled: ${PIPELINE_SERVICE_IP_INFO_ENABLED:-false}
hostIp: ${PIPELINE_SERVICE_CLIENT_HOST_IP:-""}
healthCheckInterval: ${PIPELINE_SERVICE_CLIENT_HEALTH_CHECK_INTERVAL:-300}
verifySSL: ${PIPELINE_SERVICE_CLIENT_VERIFY_SSL:-"no-ssl"} # Possible values are "no-ssl", "ignore", "validate"
sslConfig:
certificatePath: ${PIPELINE_SERVICE_CLIENT_SSL_CERT_PATH:-""} # Local path for the Pipeline Service Client
# Default required parameters for Airflow as Pipeline Service Client
parameters:
username: ${AIRFLOW_USERNAME:-admin}
password: ${AIRFLOW_PASSWORD:-admin}
timeout: ${AIRFLOW_TIMEOUT:-10}
# If we need to use SSL to reach Airflow
truststorePath: ${AIRFLOW_TRUST_STORE_PATH:-""}
truststorePassword: ${AIRFLOW_TRUST_STORE_PASSWORD:-""}
```
**Note:** Follow [this](/developers/bots) guide to configure the `ingestion-bot` credentials for

View File

@ -57,8 +57,8 @@ We specify which public certificate must be used to validate the OM server conne
- In **docker**:
```yaml
AIRFLOW_VERIFY_SSL=validate
AIRFLOW_SSL_CERT_PATH=/path/to/certificate/in/airflow
PIPELINE_SERVICE_CLIENT_VERIFY_SSL=validate
PIPELINE_SERVICE_CLIENT_SSL_CERT_PATH=/path/to/certificate/in/airflow
```
- In **bare metal**:
@ -66,7 +66,7 @@ AIRFLOW_SSL_CERT_PATH=/path/to/certificate/in/airflow
Edit the `conf/openmetadata.yaml` file:
```yaml
airflowConfiguration:
pipelineServiceClientConfiguration:
verifySSL: "validate"
sslConfig:
validate:
@ -92,7 +92,7 @@ When doing any call to the secured OM server, the certificate validation will be
- In **docker**:
```yaml
AIRFLOW_VERIFY_SSL=ignore
PIPELINE_SERVICE_CLIENT_VERIFY_SSL=ignore
```
- In **bare metal**:
@ -100,7 +100,7 @@ AIRFLOW_VERIFY_SSL=ignore
Edit the `conf/openmetadata.yaml` file:
```yaml
airflowConfiguration:
pipelineServiceClientConfiguration:
verifySSL: "ignore"
```

View File

@ -60,11 +60,24 @@ airflowConfiguration:
**After 0.12.1**
```yaml
airflowConfiguration:
apiEndpoint: ${AIRFLOW_HOST:-http://localhost:8080}
username: ${AIRFLOW_USERNAME:-admin}
password: ${AIRFLOW_PASSWORD:-admin}
pipelineServiceClientConfiguration:
apiEndpoint: ${PIPELINE_SERVICE_CLIENT_ENDPOINT:-http://localhost:8080}
metadataApiEndpoint: ${SERVER_HOST_API_URL:-http://localhost:8585/api}
ingestionIpInfoEnabled: ${PIPELINE_SERVICE_IP_INFO_ENABLED:-false}
hostIp: ${PIPELINE_SERVICE_CLIENT_HOST_IP:-""}
healthCheckInterval: ${PIPELINE_SERVICE_CLIENT_HEALTH_CHECK_INTERVAL:-300}
verifySSL: ${PIPELINE_SERVICE_CLIENT_VERIFY_SSL:-"no-ssl"} # Possible values are "no-ssl", "ignore", "validate"
sslConfig:
certificatePath: ${PIPELINE_SERVICE_CLIENT_SSL_CERT_PATH:-""} # Local path for the Pipeline Service Client
# Default required parameters for Airflow as Pipeline Service Client
parameters:
username: ${AIRFLOW_USERNAME:-admin}
password: ${AIRFLOW_PASSWORD:-admin}
timeout: ${AIRFLOW_TIMEOUT:-10}
# If we need to use SSL to reach Airflow
truststorePath: ${AIRFLOW_TRUST_STORE_PATH:-""}
truststorePassword: ${AIRFLOW_TRUST_STORE_PASSWORD:-""}
```
**Note:** Follow [this](/developers/bots) guide to configure the `ingestion-bot` credentials for