yujunjun/datahub
2
0
Fork 0
mirror of https://github.com/datahub-project/datahub.git synced 2025-12-27 09:58:14 +00:00
Code Issues Packages Projects Releases Wiki Activity

fix(metadata-ingestion) update vertexAI source doc with permissions detail (#13219)

Browse Source
This commit is contained in:
ryota-cloud 2025-04-15 13:37:26 -07:00 committed by GitHub
parent 5da4698ed9
commit e79445e469
No known key found for this signature in database
GPG Key ID: B5690EEEBB952194
1 changed files with 28 additions and 2 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

30
metadata-ingestion/docs/sources/vertexai/vertexai_pre.md
View File

@ -4,7 +4,34 @@ Ingesting metadata from VertexAI requires using the **Vertex AI** module.
Please refer to the [Vertex AI documentation](https://cloud.google.com/vertex-ai/docs) for basic information on Vertex AI.
#### Credentials to access to GCP
Please read the section to understand how to set up application default Credentials to GCP [GCP docs](https://cloud.google.com/docs/authentication/provide-credentials-adc#how-to).
Please read the section to understand how to set up application default Credentials to [GCP docs](https://cloud.google.com/docs/authentication/provide-credentials-adc#how-to).
##### Permissions
- Grant the following permissions to the Service Account on every project where you would like to extract metadata from
Default GCP Role which contains these permissions [roles/aiplatform.viewer](https://cloud.google.com/vertex-ai/docs/general/access-control#aiplatform.viewer)
| Permission | Description |
|-------------------------------------|---------------------------------------------------------------------------|
| `aiplatform.models.list` | Allows a user to view and list all ML models in a project |
| `aiplatform.models.get` | Allows a user to view details of a specific ML model |
| `aiplatform.endpoints.list` | Allows a user to view and list all prediction endpoints in a project |
| `aiplatform.endpoints.get` | Allows a user to view details of a specific prediction endpoint |
| `aiplatform.trainingPipelines.list` | Allows a user to view and list all training pipelines in a project |
| `aiplatform.trainingPipelines.get` | Allows a user to view details of a specific training pipeline |
| `aiplatform.customJobs.list` | Allows a user to view and list all custom jobs in a project |
| `aiplatform.customJobs.get` | Allows a user to view details of a specific custom job |
| `aiplatform.experiments.list` | Allows a user to view and list all experiments in a project |
| `laiplatform.experiments.get` | Allows a user to view details of a specific experiment in a project |
| `aiplatform.metadataStores.list` | allows a user to view and list all metadata store in a project |
| `aiplatform.metadataStores.get` | allows a user to view details of a specific metadata store |
| `aiplatform.executions.list` | allows a user to view and list all executions in a project |
| `aiplatform.executions.get` | allows a user to view details of a specific execution |
| `aiplatform.datasets.list` | allows a user to view and list all datasets in a project |
| `aiplatform.datasets.get` | allows a user to view details of a specific dataset |
| `aiplatform.pipelineJobs.get` | allows a user to view and list all pipeline jobs in a project |
| `aiplatform.pipelineJobs.list` | allows a user to view details of a specific pipeline job |
#### Create a service account and assign roles
@ -26,7 +53,6 @@ Please read the section to understand how to set up application default Credenti
"client_x509_cert_url": "https://www.googleapis.com/robot/v1/metadata/x509/test%suppproject-id-1234567.iam.gserviceaccount.com"
}
```
3. To provide credentials to the source, you can either:
- Set an environment variable: