David S. Batista
da60156174
chore: removing unused imports from tests ( #9446 )
2025-05-26 16:22:51 +00:00
David S. Batista
42b378950f
fix: DocumentRecallEvaluator changing division and adding checks for emptiness of documents ( #9380 )
...
* changing division and adding checks for emptiness of documents
* adding release notes
* adding tests
* Update releasenotes/notes/updated-doc-recall-eval-uniqueness-59b09082cf8e7593.yaml
Co-authored-by: Stefano Fiorucci <stefanofiorucci@gmail.com>
* attending PR comments
* Update releasenotes/notes/updated-doc-recall-eval-uniqueness-59b09082cf8e7593.yaml
* Update releasenotes/notes/updated-doc-recall-eval-uniqueness-59b09082cf8e7593.yaml
Co-authored-by: Julian Risch <julian.risch@deepset.ai>
* Update haystack/components/evaluators/document_recall.py
Co-authored-by: Julian Risch <julian.risch@deepset.ai>
* Update haystack/components/evaluators/document_recall.py
Co-authored-by: Julian Risch <julian.risch@deepset.ai>
* Update haystack/components/evaluators/document_recall.py
Co-authored-by: Julian Risch <julian.risch@deepset.ai>
* Update haystack/components/evaluators/document_recall.py
Co-authored-by: Julian Risch <julian.risch@deepset.ai>
* adding tests
* linting
---------
Co-authored-by: Stefano Fiorucci <stefanofiorucci@gmail.com>
Co-authored-by: Julian Risch <julian.risch@deepset.ai>
2025-05-14 11:37:47 +02:00
Massimiliano Pippi
10c675d534
chore: add license header to all modules ( #7675 )
...
* add license header to modules
* check license header at linting time
2024-05-09 13:40:36 +00:00
Stefano Fiorucci
94467149c1
fix: fix serialization of DocumentRecallEvaluator ( #7662 )
...
* fix serialization of DocumentRecallEvaluator
* add requested tests
2024-05-08 16:00:49 +02:00
Julian Risch
e974a23fa3
docs: Fix eval metric examples in docstrings ( #7505 )
...
* fix eval metric docstrings, change type of individual scores
* change import order
* change exactmatch docstring to single ground truth answer
* change exactmatch comment to single ground truth answer
* reverted changing docs to single ground truth
* add warm up in SASEvaluator example
* fix FaithfulnessEvaluator docstring example
* extend FaithfulnessEvaluator docstring example
* Update FaithfulnessEvaluator init docstring
* Remove outdated default from LLMEvaluator docstring
* Add examples param to LLMEvaluator docstring example
* Add import and print to LLMEvaluator docstring example
2024-04-10 11:00:20 +02:00
Silvano Cerza
dc87f51759
refactor: Remove questions inputs from evaluators ( #7466 )
...
* Remove questions input from AnswerExactMatchEvaluator
* Remove questions input from DocumentRecallEvaluator
2024-04-04 14:14:18 +02:00
Silvano Cerza
685343d13f
feat: Add DocumentRecallEvaluator ( #7399 )
...
* Add DocumentRecallEvaluator
* Fix mypy error
* Simplify recall logic and change output for single hit mode
* Remove unused import
* Add comment for RecallMode fields
* Reword RecallMode comments
Co-authored-by: Madeesh Kannan <shadeMe@users.noreply.github.com>
---------
Co-authored-by: Madeesh Kannan <shadeMe@users.noreply.github.com>
2024-03-26 16:15:03 +01:00
