mirror of
https://github.com/open-metadata/OpenMetadata.git
synced 2025-12-25 06:28:22 +00:00
Docs: Filter Pattern Example Updation (#19918)
Co-authored-by: Rounak Dhillon <rounakdhillon@Rounaks-MacBook-Air.local>
This commit is contained in:
parent
c207c8d4f3
commit
83d2e0e59d
@ -417,3 +417,42 @@ sourceConfig:
|
||||
includes:
|
||||
- .*\.PUBLIC\.CUSTOMER$
|
||||
```
|
||||
|
||||
|
||||
|
||||
#### Example 3
|
||||
|
||||
In this example, we aim to ingest a table named `_delta_log/file.json` within the `session` schema of any database. To achieve this, we need to configure the following filter patterns:
|
||||
- Include Table Filter Pattern: `.*_delta_log/file\.json$`
|
||||
- Schema Filter Pattern: `session`
|
||||
|
||||
{% note %}
|
||||
|
||||
The backslash (\) is used as an escape character for the dot (.) in the pattern
|
||||
|
||||
{% /note %}
|
||||
|
||||
### Configuring Filters via UI for Example 3
|
||||
|
||||
{% image
|
||||
src="/images/v1.6/features/ingestion/workflows/metadata/filter-patterns/table-filter-example-3.webp"
|
||||
alt="Table Filter Pattern Example 3"
|
||||
caption="Table Filter Pattern Example 3"
|
||||
/%}
|
||||
|
||||
|
||||
|
||||
### Configuring Filters via CLI for Example 3
|
||||
|
||||
```yaml
|
||||
sourceConfig:
|
||||
config:
|
||||
...
|
||||
useFqnForFiltering: true
|
||||
tableFilterPattern:
|
||||
includes:
|
||||
- session
|
||||
tableFilterPattern:
|
||||
includes:
|
||||
- "*_delta_log/file\.json$"
|
||||
```
|
||||
|
||||
@ -417,3 +417,41 @@ sourceConfig:
|
||||
includes:
|
||||
- .*\.PUBLIC\.CUSTOMER$
|
||||
```
|
||||
|
||||
|
||||
#### Example 3
|
||||
|
||||
In this example, we aim to ingest a table named `_delta_log/file.json` within the `session` schema of any database. To achieve this, we need to configure the following filter patterns:
|
||||
- Include Table Filter Pattern: `.*_delta_log/file\.json$`
|
||||
- Schema Filter Pattern: `session`
|
||||
|
||||
{% note %}
|
||||
|
||||
The backslash (\) is used as an escape character for the dot (.) in the pattern
|
||||
|
||||
{% /note %}
|
||||
|
||||
### Configuring Filters via UI for Example 3
|
||||
|
||||
{% image
|
||||
src="/images/v1.7/features/ingestion/workflows/metadata/filter-patterns/table-filter-example-3.webp"
|
||||
alt="Table Filter Pattern Example 3"
|
||||
caption="Table Filter Pattern Example 3"
|
||||
/%}
|
||||
|
||||
|
||||
|
||||
### Configuring Filters via CLI for Example 3
|
||||
|
||||
```yaml
|
||||
sourceConfig:
|
||||
config:
|
||||
...
|
||||
useFqnForFiltering: true
|
||||
tableFilterPattern:
|
||||
includes:
|
||||
- session
|
||||
tableFilterPattern:
|
||||
includes:
|
||||
- "*_delta_log/file\.json$"
|
||||
```
|
||||
|
||||
Binary file not shown.
|
After Width: | Height: | Size: 28 KiB |
Binary file not shown.
|
After Width: | Height: | Size: 28 KiB |
Loading…
x
Reference in New Issue
Block a user