haystack/releasenotes/notes/recall-evaluator-5595470406e93ad2.yaml
Silvano Cerza 685343d13f
feat: Add DocumentRecallEvaluator (#7399)
* Add DocumentRecallEvaluator

* Fix mypy error

* Simplify recall logic and change output for single hit mode

* Remove unused import

* Add comment for RecallMode fields

* Reword RecallMode comments

Co-authored-by: Madeesh Kannan <shadeMe@users.noreply.github.com>

---------

Co-authored-by: Madeesh Kannan <shadeMe@users.noreply.github.com>
2024-03-26 16:15:03 +01:00

7 lines
276 B
YAML

---
features:
- |
Add `DocumentRecallEvaluator`, a Component that can be used to calculate the Recall single-hit or multi-hit
metric given a list of questions, a list of expected documents for each question and the list of predicted
documents for each question.