mirror of
https://github.com/deepset-ai/haystack.git
synced 2025-07-25 18:00:28 +00:00
7 lines
318 B
YAML
7 lines
318 B
YAML
|
---
|
||
|
|
enhancements:
|
||
|
|
- |
|
||
|
|
Added `unicode_normalization` parameter to the DocumentCleaner, allowing to normalize the text to NFC, NFD, NFKC, or NFKD.
|
||
|
|
- |
|
||
|
|
Added `ascii_only` parameter to the DocumentCleaner, transforming letters with diacritics to their ASCII equivalent and removing other non-ASCII characters.
|