mirror of
https://github.com/deepset-ai/haystack.git
synced 2026-01-07 04:27:15 +00:00
77d4c2ca1c
* Add milvus benchmarking support * Add latest docstring and tutorial changes * Edit config * Disable docker interactive mode * Add milvus index type support * Adjust FAISS and Milvus node branching * Remove duplicate in config * Revert method for speedup * Add latest docstring and tutorial changes * Add latest benchmark run * Add latest docstring and tutorial changes * Add json files * Revert "Add latest docstring and tutorial changes" This reverts commit e2efa5f08aa4fb55bbeeed42aa76817d63fc8923. * Add latest docstring and tutorial changes * Revert "Add latest docstring and tutorial changes" This reverts commit b085a679b9d5f175e91c2c59565e73c5dec1374b. * Fix typo Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
3.7 KiB
3.7 KiB
| 1 | retriever | doc_store | n_docs | n_queries | retrieve_time | queries_per_second | seconds_per_query | recall | map | top_k | date_time | error | |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| 2 | 9 | dpr | elasticsearch | 10000 | 5637 | 245.9020519811238 | 22.92376153263135 | 0.043622858254589995 | 97.49866950505589 | 89.87097014904357 | 10 | 2021-04-12 22:50:49.396735 | |
| 3 | 14 | elastic | elasticsearch | 100000 | 5637 | 34.05730972948368 | 165.51512861040828 | 0.006041743787384013 | 71.93542664537875 | 56.25959153101251 | 10 | 2021-04-12 23:13:45.908089 | |
| 4 | 8 | elastic | elasticsearch | 10000 | 5637 | 21.6593179620686 | 260.2575025618042 | 0.0038423484055470285 | 81.1424516586837 | 66.33019927857616 | 10 | 2021-04-12 22:45:31.522940 | |
| 5 | 3 | dpr | elasticsearch | 1000 | 1064 | 30.71146336113452 | 34.645044017879535 | 0.02886415729429936 | 99.15413533834587 | 92.9510532283089 | 10 | 2021-04-12 22:36:03.760187 | |
| 6 | 2 | elastic | elasticsearch | 1000 | 1064 | 2.977487905904127 | 357.3482189096959 | 0.002798390889007638 | 89.09774436090225 | 74.2044471297291 | 10 | 2021-04-12 22:34:57.937655 | |
| 7 | 15 | dpr | elasticsearch | 100000 | 5637 | 1052.5279855618428 | 5.3556770720836955 | 0.18671775511120148 | 95.7956359765833 | 86.54606328368972 | 10 | 2021-04-12 23:36:05.648808 | |
| 8 | 20 | elastic | elasticsearch | 500000 | 5637 | 62.07282430688065 | 90.81268756406739 | 0.011011677187667313 | 62.746141564662054 | 45.60339705629754 | 10 | 2021-04-13 00:49:21.340846 | |
| 9 | 21 | dpr | elasticsearch | 500000 | 5637 | 4574.405559586667 | 1.2322912620168613 | 0.8114964625841169 | 93.0814262905801 | 80.8613722823409 | 10 | 2021-04-13 02:26:34.009405 | |
| 10 | 4 | dpr | faiss_flat | 1000 | 1064 | 26.330981328930648 | 40.408672457298465 | 0.024747162903130306 | 99.15413533834587 | 92.9510532283089 | 10 | 2021-04-12 22:37:12.563041 | |
| 11 | 22 | dpr | faiss_flat | 500000 | 5637 | 3657.0574446742394 | 1.5414031869280982 | 0.6487595253990136 | 93.0814262905801 | 80.86137228234091 | 10 | 2021-04-13 03:45:25.432560 | |
| 12 | 10 | dpr | faiss_flat | 10000 | 5637 | 201.07035204221756 | 28.03496359730067 | 0.03566974490725875 | 97.49866950505589 | 89.87097014904354 | 10 | 2021-04-12 22:55:15.966314 | |
| 13 | 16 | dpr | faiss_flat | 100000 | 5637 | 850.93480880688 | 6.6244792687512675 | 0.150955261452347 | 95.7956359765833 | 86.54606328368972 | 10 | 2021-04-12 23:54:18.954839 | |
| 14 | 11 | dpr | faiss_hnsw | 10000 | 5637 | 133.81918276423676 | 42.12400556900196 | 0.023739432812530912 | 96.96647152740819 | 89.49563682134192 | 10 | 2021-04-12 22:58:37.011857 | |
| 15 | 17 | dpr | faiss_hnsw | 100000 | 5637 | 138.56263777621643 | 40.68196225525062 | 0.024580918534010367 | 93.18786588610963 | 84.33419639513305 | 10 | 2021-04-13 00:02:06.239176 | |
| 16 | 23 | dpr | faiss_hnsw | 500000 | 5637 | 142.9722781331293 | 39.42722374998517 | 0.025363185760711247 | 86.90792974986695 | 75.73315903145605 | 10 | 2021-04-13 04:15:55.931738 | |
| 17 | 5 | dpr | faiss_hnsw | 1000 | 1064 | 24.00786596405669 | 44.31880791041422 | 0.022563783800805162 | 99.15413533834587 | 92.9510532283089 | 10 | 2021-04-12 22:38:15.165568 | |
| 18 | 0 | dpr | milvus_flat | 1000 | 1064 | 26.284036851771816 | 40.480844171707794 | 0.02470304215392088 | 99.15413533834587 | 92.9510532283089 | 10 | 2021-04-12 22:33:51.172786 | |
| 19 | 6 | dpr | milvus_flat | 10000 | 5637 | 147.82553930512222 | 38.132788329389 | 0.0262241510209548 | 97.49866950505589 | 89.87097014904354 | 10 | 2021-04-12 22:41:19.833104 | |
| 20 | 12 | dpr | milvus_flat | 100000 | 5637 | 199.15962131407287 | 28.30393009791128 | 0.03533078256414278 | 95.7956359765833 | 86.54606328368972 | 10 | 2021-04-12 23:03:55.360165 | |
| 21 | 18 | dpr | milvus_flat | 500000 | 5637 | 368.32888050779 | 15.30425741318099 | 0.06534129510516055 | 93.0814262905801 | 80.8613722823409 | 10 | 2021-04-13 00:17:05.346842 | |
| 22 | 1 | dpr | milvus_hnsw | 1000 | 1064 | 26.34384093301196 | 40.38894718145225 | 0.02475924899719169 | 99.15413533834587 | 92.9510532283089 | 10 | 2021-04-12 22:34:43.389192 | |
| 23 | 7 | dpr | milvus_hnsw | 10000 | 5637 | 147.73994229108212 | 38.154881561370836 | 0.02620896616836653 | 97.49866950505589 | 89.87097014904354 | 10 | 2021-04-12 22:44:25.082029 | |
| 24 | 19 | dpr | milvus_hnsw | 500000 | 5637 | 230.05139175982913 | 24.50322059292282 | 0.04081096181653879 | 85.71935426645379 | 74.85616575291942 | 10 | 2021-04-13 00:30:29.654851 | |
| 25 | 13 | dpr | milvus_hnsw | 100000 | 5637 | 200.77329401532916 | 28.076443272229284 | 0.035617047013540744 | 95.7956359765833 | 86.54606328368972 | 10 | 2021-04-12 23:09:18.273909 |