Julian Risch 9d02dc607a

feat: Add FaithfulnessEvaluator component (#7424) ...

* draft FaithfulnessEvaluator

* reno

* calculate score per statement and aggregate

* Update release note

* update default values in tests and fix import path

* remove instructions, inputs, outputs params

* remove unused imports

* add expected format example to docstring

* remove name 'llm' from tests and docstring

2024-04-04 16:33:59 +00:00

..

test_answer_exact_match.py

refactor: Remove questions inputs from evaluators (#7466)

2024-04-04 14:14:18 +02:00

test_document_map.py

refactor: Rename DocumentMeanAveragePrecision and DocumentMeanReciprocalRank (#7470)

2024-04-04 17:04:59 +02:00

test_document_mrr.py

refactor: Rename DocumentMeanAveragePrecision and DocumentMeanReciprocalRank (#7470)

2024-04-04 17:04:59 +02:00

test_document_recall.py

refactor: Remove questions inputs from evaluators (#7466)

2024-04-04 14:14:18 +02:00

test_faithfulness_evaluator.py

feat: Add FaithfulnessEvaluator component (#7424)

2024-04-04 16:33:59 +00:00

test_llm_evaluator.py

refactor: Remove name 'llm' from LLMEvaluator output (#7479)

2024-04-04 15:19:30 +00:00

test_sas_evaluator.py

feat: Add SASEvaluator (#7428)

2024-04-04 10:10:41 +02:00