mirror of
https://github.com/deepset-ai/haystack.git
synced 2026-01-08 04:56:45 +00:00
363be65a78
* Simplify ODES init * Add arguments to ES init and create script * Rename similarity_fn_name and add util fn * Create OpenSearchDocumentStore * Specify params of Open Search HNSW * Add better argument handling * Update opensearch index mapping * Edit opensearch default port * Fix HNSW mapping * Force small HNSW params * Implement auto start and stopping of document store services * Fix starting and stopping of ds service * Restore HNSW params * Add opensearch query benchmarks * Add write wait time * Revert wait time * Add timeout * Update benchmarks * Update benchmarks * Update benchmarks json * Update documentation * Update documentation * Fix similarity name * Improve argument passing * Improve stopping and starting of service
2.9 KiB
2.9 KiB
| 1 | retriever | doc_store | n_docs | indexing_time | docs_per_second | date_time | error | |
|---|---|---|---|---|---|---|---|---|
| 2 | 9 | dpr | elasticsearch | 10000 | 139.7465313429998 | 71.55812673057035 | 2021-04-12 13:06:34.024778 | |
| 3 | 14 | elastic | elasticsearch | 100000 | 205.94765839000047 | 485.56026702003703 | 2021-04-12 13:44:31.464961 | |
| 4 | 8 | elastic | elasticsearch | 10000 | 19.96974077699997 | 500.7576268349683 | 2021-04-12 13:03:44.944941 | |
| 5 | 3 | dpr | elasticsearch | 1000 | 14.592372578999857 | 68.52895199777984 | 2021-04-12 12:58:01.128834 | |
| 6 | 2 | elastic | elasticsearch | 1000 | 2.1051091760000418 | 475.034744706267 | 2021-04-12 12:57:18.604681 | |
| 7 | 15 | dpr | elasticsearch | 100000 | 1401.1558383250003 | 71.36964873196699 | 2021-04-12 14:08:31.400192 | |
| 8 | 20 | elastic | elasticsearch | 500000 | 1027.416534557 | 486.6575368242339 | 2021-04-12 17:30:22.080196 | |
| 9 | 21 | dpr | elasticsearch | 500000 | 7010.269106937998 | 71.32393812174124 | 2021-04-12 19:28:39.657070 | |
| 10 | 4 | dpr | faiss_flat | 1000 | 9.570316116999948 | 104.48975642755202 | 2021-04-12 12:58:47.918981 | |
| 11 | 22 | dpr | faiss_flat | 500000 | 5041.962777018001 | 99.16772933728758 | 2021-04-12 20:55:28.443354 | |
| 12 | 10 | dpr | faiss_flat | 10000 | 95.71089355200002 | 104.48131481049198 | 2021-04-12 13:08:50.343175 | |
| 13 | 16 | dpr | faiss_flat | 100000 | 999.8815230299997 | 100.0118491008456 | 2021-04-12 14:26:14.495997 | |
| 14 | 11 | dpr | faiss_hnsw | 10000 | 108.9302881550002 | 91.80183188142033 | 2021-04-12 13:11:13.117266 | |
| 15 | 17 | dpr | faiss_hnsw | 100000 | 1112.2988848330006 | 89.90389306648807 | 2021-04-12 14:45:22.644624 | |
| 16 | 23 | dpr | faiss_hnsw | 500000 | 5802.5877488399965 | 86.16845132586847 | 2021-04-12 22:32:53.095579 | |
| 17 | 5 | dpr | faiss_hnsw | 1000 | 9.837438108000242 | 101.65248197970928 | 2021-04-12 12:59:30.777696 | |
| 18 | 0 | dpr | milvus_flat | 1000 | 9.717840198999966 | 102.90352377917338 | 2021-04-12 12:56:32.363797 | |
| 19 | 6 | dpr | milvus_flat | 10000 | 87.06480573199997 | 114.85697252666792 | 2021-04-12 13:01:21.834327 | |
| 20 | 12 | dpr | milvus_flat | 100000 | 861.995940363 | 116.00982709720004 | 2021-04-12 13:26:00.742197 | |
| 21 | 18 | dpr | milvus_flat | 500000 | 4364.3841063849995 | 114.56370195934652 | 2021-04-12 15:58:40.069278 | |
| 22 | 1 | dpr | milvus_hnsw | 1000 | 8.522245804999784 | 117.33996212750934 | 2021-04-12 12:57:04.976604 | |
| 23 | 7 | dpr | milvus_hnsw | 10000 | 87.128293364 | 114.77327988306308 | 2021-04-12 13:03:13.381764 | |
| 24 | 19 | dpr | milvus_hnsw | 500000 | 4414.051032668 | 113.27463056035022 | 2021-04-12 17:12:50.943619 | |
| 25 | 13 | dpr | milvus_hnsw | 100000 | 864.9713281529998 | 115.61076852516385 | 2021-04-12 13:40:51.875517 | |
| 26 | 0 | sentence_transformers | elasticsearch | 1000 | 10.380210993000219 | 96.33715544648746 | 2021-06-02 08:49:29.922794 | |
| 27 | 1 | sentence_transformers | elasticsearch | 10000 | 82.89545158599958 | 120.63388049253265 | 2021-06-02 08:51:09.796056 | |
| 28 | 2 | sentence_transformers | elasticsearch | 100000 | 836.6144149759998 | 119.52937722555106 | 2021-06-02 09:05:26.454063 | |
| 29 | 3 | sentence_transformers | elasticsearch | 500000 | 4207.770141414 | 118.82778364694073 | 2021-06-02 10:16:20.514575 | |
| 30 | 1 | dpr | opensearch_flat | 100000 | 1427.47408267 | 70.05381128388427 | 2021-07-22 12:33:02.890691 | |
| 31 | 0 | elastic | opensearch_flat | 100000 | 207.3902409509992 | 482.18276588833 | 2021-07-22 12:08:18.041527 | |
| 32 | 2 | dpr | opensearch_hnsw | 100000 | 1422.2719023249992 | 70.31004397719536 | 2021-07-22 12:57:54.770107 |