haystack/releasenotes/notes/force-valid-JSON-OpeanAI-LLM-based-evaluators-64816e68f137739b.yaml
David S. Batista 75cf35c743
fix: forcing response format to be JSON valid (#7692)
* forcing response format to be JSON valid

* adding release notes

* cleaning up

* Update haystack/components/evaluators/llm_evaluator.py

Co-authored-by: Madeesh Kannan <shadeMe@users.noreply.github.com>

---------

Co-authored-by: Madeesh Kannan <shadeMe@users.noreply.github.com>
2024-05-14 10:22:38 +00:00

7 lines
225 B
YAML

---
enhancements:
- |
Enforce JSON mode on OpenAI LLM-based evaluators so that the they always return valid JSON output.
This is to ensure that the output is always in a consistent format, regardless of the input.