Docs: Filter Pattern Example Updation (#19918)

Co-authored-by: Rounak Dhillon <rounakdhillon@Rounaks-MacBook-Air.local>
This commit is contained in:
Rounak Dhillon 2025-02-21 17:43:43 +05:30 committed by GitHub
parent c207c8d4f3
commit 83d2e0e59d
No known key found for this signature in database
GPG Key ID: B5690EEEBB952194
4 changed files with 77 additions and 0 deletions

View File

@ -417,3 +417,42 @@ sourceConfig:
includes:
- .*\.PUBLIC\.CUSTOMER$
```
#### Example 3
In this example, we aim to ingest a table named `_delta_log/file.json` within the `session` schema of any database. To achieve this, we need to configure the following filter patterns:
- Include Table Filter Pattern: `.*_delta_log/file\.json$`
- Schema Filter Pattern: `session`
{% note %}
The backslash (\) is used as an escape character for the dot (.) in the pattern
{% /note %}
### Configuring Filters via UI for Example 3
{% image
src="/images/v1.6/features/ingestion/workflows/metadata/filter-patterns/table-filter-example-3.webp"
alt="Table Filter Pattern Example 3"
caption="Table Filter Pattern Example 3"
/%}
### Configuring Filters via CLI for Example 3
```yaml
sourceConfig:
config:
...
useFqnForFiltering: true
tableFilterPattern:
includes:
- session
tableFilterPattern:
includes:
- "*_delta_log/file\.json$"
```

View File

@ -417,3 +417,41 @@ sourceConfig:
includes:
- .*\.PUBLIC\.CUSTOMER$
```
#### Example 3
In this example, we aim to ingest a table named `_delta_log/file.json` within the `session` schema of any database. To achieve this, we need to configure the following filter patterns:
- Include Table Filter Pattern: `.*_delta_log/file\.json$`
- Schema Filter Pattern: `session`
{% note %}
The backslash (\) is used as an escape character for the dot (.) in the pattern
{% /note %}
### Configuring Filters via UI for Example 3
{% image
src="/images/v1.7/features/ingestion/workflows/metadata/filter-patterns/table-filter-example-3.webp"
alt="Table Filter Pattern Example 3"
caption="Table Filter Pattern Example 3"
/%}
### Configuring Filters via CLI for Example 3
```yaml
sourceConfig:
config:
...
useFqnForFiltering: true
tableFilterPattern:
includes:
- session
tableFilterPattern:
includes:
- "*_delta_log/file\.json$"
```

Binary file not shown.

After

Width:  |  Height:  |  Size: 28 KiB

Binary file not shown.

After

Width:  |  Height:  |  Size: 28 KiB