yujunjun/OpenMetadata
1
0
Fork 0
mirror of https://github.com/open-metadata/OpenMetadata.git synced 2025-11-07 14:31:08 +00:00
Code Issues Packages Projects Releases Wiki Activity

add documentation for sharded tables (#13361)

Browse Source
This commit is contained in:
Ayush Shah 2023-10-03 12:49:05 +05:30 committed by GitHub
parent bc491be5ad
commit 744e5279bc
No known key found for this signature in database
GPG Key ID: 4AEE18F83AFDEB23
3 changed files with 23 additions and 0 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

7
openmetadata-docs/content/v1.0.x/connectors/database/bigquery/index.md
View File

@ -103,6 +103,13 @@ link="/connectors/database/bigquery/roles"
/ %} / %}
{% /tilesContainer %} {% /tilesContainer %}
{% note %}
If you are using BigQuery and have sharded tables, you might want to consider using partitioned tables instead. Partitioned tables allow you to efficiently query data by date or other criteria, without having to manage multiple tables. Partitioned tables also have lower storage and query costs than sharded tables.
You can learn more about the benefits of partitioned tables [here](https://cloud.google.com/bigquery/docs/partitioned-tables#dt_partition_shard).
If you want to convert your existing sharded tables to partitioned tables, you can follow the steps in this [guide](https://cloud.google.com/bigquery/docs/creating-partitioned-tables#convert-date-sharded-tables).
This will help you simplify your data management and optimize your performance in BigQuery.
{% /note %}
## Metadata Ingestion ## Metadata Ingestion
{% stepsContainer %} {% stepsContainer %}

7
openmetadata-docs/content/v1.1.x/connectors/database/bigquery/index.md
View File

@ -84,6 +84,13 @@ link="/connectors/database/bigquery/roles"
/ %} / %}
{% /tilesContainer %} {% /tilesContainer %}
{% note %}
If you are using BigQuery and have sharded tables, you might want to consider using partitioned tables instead. Partitioned tables allow you to efficiently query data by date or other criteria, without having to manage multiple tables. Partitioned tables also have lower storage and query costs than sharded tables.
You can learn more about the benefits of partitioned tables [here](https://cloud.google.com/bigquery/docs/partitioned-tables#dt_partition_shard).
If you want to convert your existing sharded tables to partitioned tables, you can follow the steps in this [guide](https://cloud.google.com/bigquery/docs/creating-partitioned-tables#convert-date-sharded-tables).
This will help you simplify your data management and optimize your performance in BigQuery.
{% /note %}
## Metadata Ingestion ## Metadata Ingestion
{% partial {% partial

9
openmetadata-docs/content/v1.2.x-SNAPSHOT/connectors/database/bigquery/index.md
View File

@ -84,6 +84,14 @@ link="/connectors/database/bigquery/roles"
/ %} / %}
{% /tilesContainer %} {% /tilesContainer %}
{% note %}
If you are using BigQuery and have sharded tables, you might want to consider using partitioned tables instead. Partitioned tables allow you to efficiently query data by date or other criteria, without having to manage multiple tables. Partitioned tables also have lower storage and query costs than sharded tables.
You can learn more about the benefits of partitioned tables [here](https://cloud.google.com/bigquery/docs/partitioned-tables#dt_partition_shard).
If you want to convert your existing sharded tables to partitioned tables, you can follow the steps in this [guide](https://cloud.google.com/bigquery/docs/creating-partitioned-tables#convert-date-sharded-tables).
This will help you simplify your data management and optimize your performance in BigQuery.
{% /note %}
## Metadata Ingestion ## Metadata Ingestion
{% partial {% partial
@ -143,6 +151,7 @@ If you want to use [ADC authentication](https://cloud.google.com/docs/authentica
the GCP credentials empty. This is why they are not marked as required. the GCP credentials empty. This is why they are not marked as required.
{% /note %} {% /note %}
{% partial file="/v1.2/connectors/database/advanced-configuration.md" /%} {% partial file="/v1.2/connectors/database/advanced-configuration.md" /%}
{% /extraContent %} {% /extraContent %}