haystack/releasenotes/notes/add-inf-mode-reader-e6eb79920e73c956.yaml
Sebastian Husch Lee af53e8430d
feat: Add inference mode to ExtractiveReader (#7699)
* Add inference mode to ExtractiveReader

* Add release notes
2024-05-15 19:33:57 +00:00

5 lines
167 B
YAML

---
enhancements:
- |
Adds inference mode to model call of the ExtractiveReader. This prevents gradients from being calculated during inference time in pytorch.