4 Commits

Author	SHA1	Message	Date
bogdankostic	b8ff1052d4	refactor: Adapt running benchmarks (#5007) ... * Generate eval result in separate method * Adapt benchmarking utils * Adapt running retriever benchmarks * Adapt error message * Adapt running reader benchmarks * Adapt retriever reader benchmark script * Adapt running benchmarks script * Adapt README.md * Raise error if file doesn't exist * Raise error if path doesn't exist or is a directory * minor readme update * Create separate methods for checking if pipeline contains reader or retriever * Fix reader pipeline case --------- Co-authored-by: Darja Fokina <daria.f93@gmail.com>	2023-05-26 18:48:11 +02:00
Malte Pietsch	fb02b61e90	Update README.md (#3247)	2022-10-11 10:43:17 +02:00
Malte Pietsch	7e79a48540	bug: reactivate benchmarks with quick fixes (#2766) ... * quick fix benchmark runs to make them work with current haystack version * fix minor typo * update readme. fix minor things to make benchmarks run again * Update Documentation & Code Style * fix typo in readme * update result files for reader and retriever querying * reduce batch size for update embeddings to prevent xlarge bulk_update requests that exceed elastic's limits (happening in dense 500k runs) * change default memory allocation back to normal. add note to readme * add first indexing results * add memory to docker cmd * full benchmarks results on commit c5a2651fcbbeffca06ffa9036b10e62669bcc1b0 Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>	2022-09-20 10:22:08 +02:00
Branden Chan	b0483cfd99	add readme	2020-10-22 15:32:56 +02:00