Docs: Database YAML correction (#19412)

This commit is contained in:
RounakDhillon 2025-01-17 10:07:23 +05:30 committed by GitHub
parent 9111f0c0c5
commit c68bb3c06a
No known key found for this signature in database
GPG Key ID: B5690EEEBB952194
4 changed files with 14 additions and 2 deletions

View File

@ -20,6 +20,8 @@ The `sourceConfig` is defined [here](https://github.com/open-metadata/OpenMetada
**includeDDL**: Optional configuration to toggle the DDL Statements ingestion.
**overrideMetadata** *(boolean)*: Set the 'Override Metadata' toggle to control whether to override the existing metadata in the OpenMetadata server with the metadata fetched from the source. If the toggle is set to true, the metadata fetched from the source will override the existing metadata in the OpenMetadata server. If the toggle is set to false, the metadata fetched from the source will not override the existing metadata in the OpenMetadata server. This is applicable for fields like description, tags, owner and displayName.
**queryLogDuration**: Configuration to tune how far we want to look back in query logs to process Stored Procedures results.
**queryParsingTimeoutLimit**: Configuration to set the timeout for parsing the query in seconds.
@ -30,6 +32,8 @@ The `sourceConfig` is defined [here](https://github.com/open-metadata/OpenMetada
**threads (beta)**: The number of threads to use when extracting the metadata using multithreading. Please take a look [here](/connectors/ingestion/workflows/metadata/multithreading) before configuring this.
**databaseMetadataConfigType** *(string)*: Database Source Config Metadata Pipeline type.
**incremental (beta)**: Incremental Extraction configuration. Currently implemented for:
- [BigQuery](/connectors/ingestion/workflows/metadata/incremental-extraction/bigquery)

View File

@ -10,10 +10,12 @@
# includeOwners: false
# includeStoredProcedures: true
# includeDDL: true
# overrideMetadata: false
# queryLogDuration: 1
# queryParsingTimeoutLimit: 300
# useFqnForFiltering: false
# threads: 4
# threads: 1
# databaseMetadataConfigType: ()
# incremental:
# enabled: true
# lookbackDays: 7

View File

@ -20,6 +20,8 @@ The `sourceConfig` is defined [here](https://github.com/open-metadata/OpenMetada
**includeDDL**: Optional configuration to toggle the DDL Statements ingestion.
**overrideMetadata** *(boolean)*: Set the 'Override Metadata' toggle to control whether to override the existing metadata in the OpenMetadata server with the metadata fetched from the source. If the toggle is set to true, the metadata fetched from the source will override the existing metadata in the OpenMetadata server. If the toggle is set to false, the metadata fetched from the source will not override the existing metadata in the OpenMetadata server. This is applicable for fields like description, tags, owner and displayName.
**queryLogDuration**: Configuration to tune how far we want to look back in query logs to process Stored Procedures results.
**queryParsingTimeoutLimit**: Configuration to set the timeout for parsing the query in seconds.
@ -30,6 +32,8 @@ The `sourceConfig` is defined [here](https://github.com/open-metadata/OpenMetada
**threads (beta)**: The number of threads to use when extracting the metadata using multithreading. Please take a look [here](/connectors/ingestion/workflows/metadata/multithreading) before configuring this.
**databaseMetadataConfigType** *(string)*: Database Source Config Metadata Pipeline type.
**incremental (beta)**: Incremental Extraction configuration. Currently implemented for:
- [BigQuery](/connectors/ingestion/workflows/metadata/incremental-extraction/bigquery)

View File

@ -10,10 +10,12 @@
# includeOwners: false
# includeStoredProcedures: true
# includeDDL: true
# overrideMetadata: false
# queryLogDuration: 1
# queryParsingTimeoutLimit: 300
# useFqnForFiltering: false
# threads: 4
# threads: 1
# databaseMetadataConfigType: ()
# incremental:
# enabled: true
# lookbackDays: 7