yujunjun/OpenMetadata
1
0
Fork 0
mirror of https://github.com/open-metadata/OpenMetadata.git synced 2025-10-30 18:17:53 +00:00
Code Issues Packages Projects Releases Wiki Activity

Remove required fields from BQ for ADC (#7037)

Browse Source
This commit is contained in:
Pere Miquel Brull 2022-08-30 17:25:02 +02:00 committed by GitHub
parent 8708520c28
commit 9841b0887f
No known key found for this signature in database
GPG Key ID: 4AEE18F83AFDEB23
4 changed files with 27 additions and 10 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

11
catalog-rest-service/src/main/resources/json/schema/security/credentials/gcsCredentials.json
View File

@ -70,16 +70,7 @@
"format": "uri"
}
},
"additionalProperties": false,
"required": [
"type",
"projectId",
"privateKeyId",
"privateKey",
"clientEmail",
"clientId",
"clientX509CertUrl"
]
"additionalProperties": false
},
"GCSCredentialsPath": {
"title": "GCS Credentials Path",

12
openmetadata-docs/content/openmetadata/connectors/database/bigquery/airflow.md
View File

@ -204,6 +204,18 @@ credentials:
- In case you are using Single-Sign-On (SSO) for authentication, add the `authenticator` details in the Connection Arguments as a Key-Value pair as follows: `"authenticator" : "sso_login_url"`
- In case you authenticate with SSO using an external browser popup, then add the `authenticator` details in the Connection Arguments as a Key-Value pair as follows: `"authenticator" : "externalbrowser"`
If you want to use [ADC authentication](https://cloud.google.com/docs/authentication#adc) for BigQuery you can just leave
the GCS credentials empty. This is why they are not marked as required.
```yaml
...
config:
type: BigQuery
credentials:
gcsConfig: {}
...
```
#### Source Configuration - Source Config
The `sourceConfig` is defined [here](https://github.com/open-metadata/OpenMetadata/blob/main/catalog-rest-service/src/main/resources/json/schema/metadataIngestion/databaseServiceMetadataPipeline.json):

12
openmetadata-docs/content/openmetadata/connectors/database/bigquery/cli.md
View File

@ -204,6 +204,18 @@ credentials:
- In case you are using Single-Sign-On (SSO) for authentication, add the `authenticator` details in the Connection Arguments as a Key-Value pair as follows: `"authenticator" : "sso_login_url"`
- In case you authenticate with SSO using an external browser popup, then add the `authenticator` details in the Connection Arguments as a Key-Value pair as follows: `"authenticator" : "externalbrowser"`
If you want to use [ADC authentication](https://cloud.google.com/docs/authentication#adc) for BigQuery you can just leave
the GCS credentials empty. This is why they are not marked as required.
```yaml
...
config:
type: BigQuery
credentials:
gcsConfig: {}
...
```
#### Source Configuration - Source Config
The `sourceConfig` is defined [here](https://github.com/open-metadata/OpenMetadata/blob/main/catalog-rest-service/src/main/resources/json/schema/metadataIngestion/databaseServiceMetadataPipeline.json):

2
openmetadata-docs/content/openmetadata/connectors/database/bigquery/index.md
View File

@ -179,6 +179,8 @@ the changes.
- In case you are using Single-Sign-On (SSO) for authentication, add the `authenticator` details in the Connection Arguments as a Key-Value pair as follows: `"authenticator" : "sso_login_url"`
- In case you authenticate with SSO using an external browser popup, then add the `authenticator` details in the Connection Arguments as a Key-Value pair as follows: `"authenticator" : "externalbrowser"`
If you want to use [ADC authentication](https://cloud.google.com/docs/authentication#adc) for BigQuery you can just leave
the GCS credentials empty. This is why they are not marked as required.
### 6. Configure Metadata Ingestion