mirror of
https://github.com/deepset-ai/haystack.git
synced 2025-07-14 20:40:33 +00:00
2531c8e061
* add time and perf benchmark for es * Add retriever benchmarking * Add Reader benchmarking * add nq to squad conversion * add conversion stats * clean benchmarks * Add link to dataset * Update imports * add first support for neg psgs * Refactor test * set max_seq_len * cleanup benchmark * begin retriever speed benchmarking * Add support for retriever query index benchmarking * improve reader eval, retriever speed benchmarking * improve retriever speed benchmarking * Add retriever accuracy benchmark * Add neg doc shuffling * Add top_n * 3x speedup of SQL. add postgres docker run. make shuffle neg a param. add more logging * Add models to sweep * add option for faiss index type * remove unneeded line * change faiss to faiss_flat * begin automatic benchmark script * remove existing postgres docker for benchmarking * Add data processing scripts * Remove shuffle in script bc data already shuffled * switch hnsw setup from 256 to 128 * change es similarity to dot product by default * Error includes stack trace * Change ES default timeout * remove delete_docs() from timing for indexing * Add support for website export * update website on push to benchmarks * add complete benchmarks results * new json format * removed NaN as is not a valid json token * versioning for docs * unsaved changes * cleaning * cleaning * Edit format of benchmarks data * update also jsons in v0.4.0 Co-authored-by: brandenchan <brandenchan@icloud.com> Co-authored-by: deepset <deepset@Crenolape.localdomain> Co-authored-by: Malte Pietsch <malte.pietsch@deepset.ai>
52 lines
1.0 KiB
Python
52 lines
1.0 KiB
Python
headers = {
|
|
1: """<!---
|
|
title: "Tutorial 1"
|
|
metaTitle: "Build Your First QA System"
|
|
metaDescription: ""
|
|
slug: "/docs/tutorial1"
|
|
date: "2020-09-03"
|
|
id: "tutorial1md"
|
|
--->""",
|
|
2: """<!---
|
|
title: "Tutorial 2"
|
|
metaTitle: "Fine-tuning a model on your own data"
|
|
metaDescription: ""
|
|
slug: "/docs/tutorial2"
|
|
date: "2020-09-03"
|
|
id: "tutorial2md"
|
|
--->""",
|
|
3: """<!---
|
|
title: "Tutorial 3"
|
|
metaTitle: "Build a QA System Without Elasticsearch"
|
|
metaDescription: ""
|
|
slug: "/docs/tutorial3"
|
|
date: "2020-09-03"
|
|
id: "tutorial3md"
|
|
--->""",
|
|
4: """<!---
|
|
title: "Tutorial 4"
|
|
metaTitle: "Utilizing existing FAQs for Question Answering"
|
|
metaDescription: ""
|
|
slug: "/docs/tutorial4"
|
|
date: "2020-09-03"
|
|
id: "tutorial4md"
|
|
--->""",
|
|
5: """<!---
|
|
title: "Tutorial 5"
|
|
metaTitle: "Evaluation of a QA System"
|
|
metaDescription: ""
|
|
slug: "/docs/tutorial5"
|
|
date: "2020-09-03"
|
|
id: "tutorial5md"
|
|
--->""",
|
|
6: """<!---
|
|
title: "Tutorial 6"
|
|
metaTitle: "Better retrieval via Dense Passage Retrieval"
|
|
metaDescription: ""
|
|
slug: "/docs/tutorial6"
|
|
date: "2020-09-03"
|
|
id: "tutorial6md"
|
|
--->"""
|
|
|
|
}
|