haystack/change-context-relevance-evaluator-da770bf05c83cfbd.yaml at b51bb6e5a99abe32e855e7cca3680d392843d77c - haystack - Gitea: Git with a cup of tea

yujunjun/haystack

mirror of https://github.com/deepset-ai/haystack.git synced 2025-12-05 11:27:15 +00:00

David S. Batista 0c9dc008f0

fix: improve context relevancy metric (#7964 )

* fixing tests

* fixing tests

* updating tests

* updating tests

* updating docstring

* adding release notes

* making the insufficient information more robust

* updating docstring and release notes

* empty list instead of informative string

* Update haystack/components/evaluators/context_relevance.py

Co-authored-by: Madeesh Kannan <shadeMe@users.noreply.github.com>

* Update haystack/components/evaluators/context_relevance.py

Co-authored-by: Madeesh Kannan <shadeMe@users.noreply.github.com>

* fixing tests

* Update haystack/components/evaluators/context_relevance.py

Co-authored-by: Stefano Fiorucci <stefanofiorucci@gmail.com>

* reverting commit

* reverting again commit

* fixing docstrings

* removing deprecation warning

* removing warning import

---------

Co-authored-by: Madeesh Kannan <shadeMe@users.noreply.github.com>
Co-authored-by: Stefano Fiorucci <stefanofiorucci@gmail.com>

2024-07-22 15:13:46 +02:00

7 lines

247 B

YAML

Raw Blame History

 ---
 upgrade:
   - |
     The `ContextRelevanceEvaluator` now returns a list of relevant sentences for each context, instead of all the sentences in a context.
     Also, a score of 1 is now returned if a relevant sentence is found, and 0 otherwise.