diff --git a/openmetadata-docs/content/partials/v1.4/connectors/yaml/database/source-config-def.md b/openmetadata-docs/content/partials/v1.4/connectors/yaml/database/source-config-def.md index bdcb8a81ef4..92e9fb1258a 100644 --- a/openmetadata-docs/content/partials/v1.4/connectors/yaml/database/source-config-def.md +++ b/openmetadata-docs/content/partials/v1.4/connectors/yaml/database/source-config-def.md @@ -12,4 +12,12 @@ The `sourceConfig` is defined [here](https://github.com/open-metadata/OpenMetada **databaseFilterPattern**, **schemaFilterPattern**, **tableFilterPattern**: Note that the filter supports regex as include or exclude. You can find examples [here](/connectors/ingestion/workflows/metadata/filter-patterns/database) -{% /codeInfo %} \ No newline at end of file +**threads (beta)**: The number of threads to use when extracting the metadata using multithreading. Please take a look [here](/connectors/ingestion/workflows/metadata/multithreading) before configuring this. + +**incremental (beta)**: Incremental Extraction configuration. Currently implemented for: + +- [BigQuery](/connectors/ingestion/workflows/metadata/incremental-extraction/bigquery) +- [Redshift](/connectors/ingestion/workflows/metadata/incremental-extraction/redshift) +- [Snowflake](/connectors/ingestion/workflows/metadata/incremental-extraction/snowflake) + +{% /codeInfo %} diff --git a/openmetadata-docs/content/partials/v1.4/connectors/yaml/database/source-config.md b/openmetadata-docs/content/partials/v1.4/connectors/yaml/database/source-config.md index 6046ebe9d35..700b9346de6 100644 --- a/openmetadata-docs/content/partials/v1.4/connectors/yaml/database/source-config.md +++ b/openmetadata-docs/content/partials/v1.4/connectors/yaml/database/source-config.md @@ -5,6 +5,11 @@ markDeletedTables: true includeTables: true includeViews: true + # threads: 4 + # incremental: + # enabled: true + # lookbackDays: 7 + # safetyMarginDays: 1 # includeTags: true # databaseFilterPattern: # includes: @@ -27,4 +32,4 @@ # excludes: # - table3 # - table4 -``` \ No newline at end of file +```