fix: update gke docs (#7020)

This commit is contained in:
Akash Jain 2022-08-29 20:56:58 +05:30 committed by GitHub
parent b775649ba8
commit fdce6afa6d
No known key found for this signature in database
GPG Key ID: 4AEE18F83AFDEB23

View File

@ -104,12 +104,18 @@ kubectl create -f nfs-cluster-ip-service.yml
``` ```
We create a CluserIP Service for pods to access NFS within the cluster at a fixed IP/DNS. We create a CluserIP Service for pods to access NFS within the cluster at a fixed IP/DNS.
Now your nfs server pods are accessible either at the IP (note yours from the service output) or via its name nfs-server.default.svc.cluster.local. By default every service is addressable via name `<service-name>.<namespace>.svc.cluster.local`.
</Collapse> </Collapse>
### Provision NFS backed PV and PVC for Airflow DAGs and Airflow Logs ### Provision NFS backed PV and PVC for Airflow DAGs and Airflow Logs
Update `<NFS_SERVER_CLUSTER_IP>` with the NFS Service Cluster IP Address for below code snippets.
You can get the clusterIP using the following command
```commandline
kubectl get service nfs-server -o jsonpath='{.spec.clusterIP}'
```
<Collapse title="Code Samples for PV and PVC for Airflow DAGs"> <Collapse title="Code Samples for PV and PVC for Airflow DAGs">
```yaml ```yaml
@ -124,7 +130,7 @@ spec:
accessModes: accessModes:
- ReadWriteMany - ReadWriteMany
nfs: nfs:
server: nfs-server.default.svc.cluster.local server: <NFS_SERVER_CLUSTER_IP>
path: "/" path: "/"
--- ---
@ -167,7 +173,7 @@ spec:
accessModes: accessModes:
- ReadWriteMany - ReadWriteMany
nfs: nfs:
server: nfs-server.default.svc.cluster.local server: <NFS_SERVER_CLUSTER_IP>
path: "/" path: "/"
--- ---
@ -210,17 +216,13 @@ metadata:
name: my-permission-pod name: my-permission-pod
spec: spec:
containers: containers:
- image: busybox - image: nginx
name: my-permission-pod name: my-permission-pod
volumeMounts: volumeMounts:
- name: airflow-dags - name: airflow-dags
mountPath: /airflow-dags mountPath: /airflow-dags
- name: airflow-logs - name: airflow-logs
mountPath: /airflow-logs mountPath: /airflow-logs
command:
- "chown -R 50000 /airflow-dags /airflow-logs"
# if needed
- "chmod -R a+rwx /airflow-dags"
volumes: volumes:
- name: airflow-logs - name: airflow-logs
persistentVolumeClaim: persistentVolumeClaim:
@ -244,6 +246,14 @@ Run the below command to create the pod and fix the permissions
kubectl create -f permissions_pod.yml kubectl create -f permissions_pod.yml
``` ```
Once the permissions pod is up and running, execute the below commands within the container.
```commandline
kubectl exec --tty my-permission-pod --container my-permission-pod -- chown -R 50000 /airflow-dags /airflow-log
# If needed
kubectl exec --tty my-permission-pod --container my-permission-pod -- chmod -R a+rwx /airflow-dags
```
## Create OpenMetadata dependencies Values ## Create OpenMetadata dependencies Values
Override openmetadata dependencies airflow helm values to bind the nfs persistent volumes for DAGs and logs. Override openmetadata dependencies airflow helm values to bind the nfs persistent volumes for DAGs and logs.