haystack/releasenotes/notes/text-cleaner-eee0eecbdec21427.yaml
Silvano Cerza c82f787b41
feat: Add TextCleaner component (#6997)
* Add TextCleaner component

* Update docstrings and simplify run logic

* Update docstrings
2024-02-15 16:10:38 +01:00

7 lines
290 B
YAML

---
features:
- |
Add `TextCleaner` Component to clean list of strings. It can remove substrings matching a list of regular expressions,
convert text to lowercase, remove punctuation, and remove numbers.
This is mostly useful to clean generator predictions before evaluation.