6 Commits

Author	SHA1	Message	Date
David S. Batista	de76d20f12	fix: updating end2end evaluation tests (#9053) ... * updating tests * fixing tests, default now is JSON object and no longer dataframe * cleaning up leftovers	2025-03-18 10:52:05 +01:00
David S. Batista	97126eb544	fix: changing default model to gpt-4o-mini on OpenAI API calls (#8360) ... * chaning default model to gpt-4o-mini * adding release notes * fixing some missed tests * fixing some more missed tests * fixing one last missed test * fixing linting issues * making pylint happy about an end2end test * chaning if test to walruss operator * fixing azure embedder from ada to text-embedding-ada-002	2024-09-17 10:36:42 +02:00
David S. Batista	276ff3c104	test evaluation pipeline failing (#7823)	2024-06-07 11:26:18 +02:00
Massimiliano Pippi	10c675d534	chore: add license header to all modules (#7675) ... * add license header to modules * check license header at linting time	2024-05-09 13:40:36 +00:00
Julian Risch	48c7c6ad26	test: Rename responses and use preds instead of ground truth answers in e2e eval test (#7640) ... * rename responses, use preds instead of ground truth answers * fix typo in component name	2024-05-03 12:48:42 +02:00
David S. Batista	8d04e530da	test: end2end evaluation tests (#7601) ... * initial import * wip * cleaning up tests * fixing tests * adding context relevance * reverting some wrong changes to due PyCharm error in refactoring * building eval pipeline only once * handling mypy issues	2024-04-26 14:07:05 +00:00