Markus Paff 2531c8e061
Add versioning docs (#495)
* add time and perf benchmark for es

* Add retriever benchmarking

* Add Reader benchmarking

* add nq to squad conversion

* add conversion stats

* clean benchmarks

* Add link to dataset

* Update imports

* add first support for neg psgs

* Refactor test

* set max_seq_len

* cleanup benchmark

* begin retriever speed benchmarking

* Add support for retriever query index benchmarking

* improve reader eval, retriever speed benchmarking

* improve retriever speed benchmarking

* Add retriever accuracy benchmark

* Add neg doc shuffling

* Add top_n

* 3x speedup of SQL. add postgres docker run. make shuffle neg a param. add more logging

* Add models to sweep

* add option for faiss index type

* remove unneeded line

* change faiss to faiss_flat

* begin automatic benchmark script

* remove existing postgres docker for benchmarking

* Add data processing scripts

* Remove shuffle in script bc data already shuffled

* switch hnsw setup from 256 to 128

* change es similarity to dot product by default

* Error includes stack trace

* Change ES default timeout

* remove delete_docs() from timing for indexing

* Add support for website export

* update website on push to benchmarks

* add complete benchmarks results

* new json format

* removed NaN as is not a valid json token

* versioning for docs

* unsaved changes

* cleaning

* cleaning

* Edit format of benchmarks data

* update also jsons in v0.4.0

Co-authored-by: brandenchan <brandenchan@icloud.com>
Co-authored-by: deepset <deepset@Crenolape.localdomain>
Co-authored-by: Malte Pietsch <malte.pietsch@deepset.ai>
2020-10-19 11:46:51 +02:00

24 lines
874 B
ReStructuredText

.. Haystack documentation master file, created by
sphinx-quickstart on Tue Jul 28 16:18:42 2020.
You can adapt this file completely to your liking, but it should at least
contain the root `toctree` directive.
Haystack is all you need to scale the latest advances in Question Answering technologies to large collections of documents.
Whether you're building a search system, asking standard questions to an incoming stream of documents or
extending your chatbot, Haystack has you covered.
This section covers the core concepts and practical usage of Haystack. See our tutorials page for end to end examples
or our API page for comprehensive descriptions of individual functions.
.. toctree::
:maxdepth: 4
:caption: Contents:
usage/intro
usage/get_started
usage/database
usage/retriever
usage/reader
usage/domain_adaptation
usage/terms