mirror of
https://github.com/open-metadata/OpenMetadata.git
synced 2025-08-30 11:56:01 +00:00
Update multithreading docs (#16513)
This commit is contained in:
parent
7558ccc432
commit
1c48a317c7
@ -12,4 +12,12 @@ The `sourceConfig` is defined [here](https://github.com/open-metadata/OpenMetada
|
||||
|
||||
**databaseFilterPattern**, **schemaFilterPattern**, **tableFilterPattern**: Note that the filter supports regex as include or exclude. You can find examples [here](/connectors/ingestion/workflows/metadata/filter-patterns/database)
|
||||
|
||||
**threads (beta)**: The number of threads to use when extracting the metadata using multithreading. Please take a look [here](/connectors/ingestion/workflows/metadata/multithreading) before configuring this.
|
||||
|
||||
**incremental (beta)**: Incremental Extraction configuration. Currently implemented for:
|
||||
|
||||
- [BigQuery](/connectors/ingestion/workflows/metadata/incremental-extraction/bigquery)
|
||||
- [Redshift](/connectors/ingestion/workflows/metadata/incremental-extraction/redshift)
|
||||
- [Snowflake](/connectors/ingestion/workflows/metadata/incremental-extraction/snowflake)
|
||||
|
||||
{% /codeInfo %}
|
@ -5,6 +5,11 @@
|
||||
markDeletedTables: true
|
||||
includeTables: true
|
||||
includeViews: true
|
||||
# threads: 4
|
||||
# incremental:
|
||||
# enabled: true
|
||||
# lookbackDays: 7
|
||||
# safetyMarginDays: 1
|
||||
# includeTags: true
|
||||
# databaseFilterPattern:
|
||||
# includes:
|
||||
|
Loading…
x
Reference in New Issue
Block a user