Branden Chan aa6f768efa

Prevent merge of same questions on different documents during evaluation (#1119) ...

* Fix duplicate question in Reader.eval()

* Add duplicate question support in document store

* Support duplicate questions in retriever eval

* Update tutorial

* Rename key_tuple

* Change error message

* Add warning when more than 6 labels

* Allow for label grouping options

* Add support for aggregating by label meta

* Satisfy mypy

* Fix duplicate question in Reader.eval()

* Add duplicate question support in document store

* Support duplicate questions in retriever eval

* Update tutorial

* Rename key_tuple

* Change error message

* Add warning when more than 6 labels

* Allow for label grouping options

* Add support for aggregating by label meta

* Satisfy mypy

* Make label field flexible, add docstrings

* Satisfy mypy

* Fix failing tests

* Adjust docstring

* Fix tutorial

Co-authored-by: Malte Pietsch <malte.pietsch@deepset.ai>

2021-06-02 12:09:03 +02:00

..

small_faq_covid.csv

Add eval for Dense Passage Retriever & Refactor handling of labels/feedback (#243)

2020-07-31 11:34:06 +02:00

small_generator_dataset.csv

[RAG] Integrate "Retrieval-Augmented Generation" with Haystack (#484)

2020-10-30 18:06:02 +01:00

Tutorial1_Basic_QA_Pipeline.ipynb

Removed comma from last item in json list (#1114)

2021-06-01 12:32:21 +02:00

Tutorial1_Basic_QA_Pipeline.py

Update tutorials (torch versions, ES version, replace Finder with Pipeline) (#814)

2021-02-09 14:56:54 +01:00

Tutorial2_Finetune_a_model_on_your_data.ipynb

Removed comma from last item in json list (#1114)

2021-06-01 12:32:21 +02:00

Tutorial2_Finetune_a_model_on_your_data.py

Adding a guard that prevents the tutorial code from being executed in every subprocess when using multiprocessing on windows (#729)

2021-01-13 18:17:54 +01:00

Tutorial3_Basic_QA_Pipeline_without_Elasticsearch.ipynb

Removed comma from last item in json list (#1114)

2021-06-01 12:32:21 +02:00

Tutorial3_Basic_QA_Pipeline_without_Elasticsearch.py

Update tutorials (torch versions, ES version, replace Finder with Pipeline) (#814)

2021-02-09 14:56:54 +01:00

Tutorial4_FAQ_style_QA.ipynb

Removed comma from last item in json list (#1114)

2021-06-01 12:32:21 +02:00

Tutorial4_FAQ_style_QA.py

Update tutorials (torch versions, ES version, replace Finder with Pipeline) (#814)

2021-02-09 14:56:54 +01:00

Tutorial5_Evaluation.ipynb

Prevent merge of same questions on different documents during evaluation (#1119)

2021-06-02 12:09:03 +02:00

Tutorial5_Evaluation.py

Prevent merge of same questions on different documents during evaluation (#1119)

2021-06-02 12:09:03 +02:00

Tutorial6_Better_Retrieval_via_DPR.ipynb

Removed comma from last item in json list (#1114)

2021-06-01 12:32:21 +02:00

Tutorial6_Better_Retrieval_via_DPR.py

Update tutorials (torch versions, ES version, replace Finder with Pipeline) (#814)

2021-02-09 14:56:54 +01:00

Tutorial7_RAG_Generator.ipynb

Removed comma from last item in json list (#1114)

2021-06-01 12:32:21 +02:00

Tutorial7_RAG_Generator.py

Fix top_k param in RAG tutorials (#906)

2021-03-18 18:00:21 +01:00

Tutorial8_Preprocessing.ipynb

Fixing grpcio-tools to version of colab's pre-installed grpcio (#1113)

2021-05-31 19:09:10 +02:00

Tutorial8_Preprocessing.py

Adding a guard that prevents the tutorial code from being executed in every subprocess when using multiprocessing on windows (#729)

2021-01-13 18:17:54 +01:00

Tutorial9_DPR_training.ipynb

Fixing grpcio-tools to version of colab's pre-installed grpcio (#1113)

2021-05-31 19:09:10 +02:00

Tutorial9_DPR_training.py

Fix DPR training batch size (#898)

2021-03-17 18:33:59 +01:00

Tutorial10_Knowledge_Graph.ipynb

Fixing grpcio-tools to version of colab's pre-installed grpcio (#1113)

2021-05-31 19:09:10 +02:00

Tutorial10_Knowledge_Graph.py

knowledge graph example (#934)

2021-04-08 14:05:33 +02:00

Tutorial11_Pipelines.ipynb

Fixing grpcio-tools to version of colab's pre-installed grpcio (#1113)

2021-05-31 19:09:10 +02:00

Tutorial11_Pipelines.py

Pipelines tutorial (#991)

2021-04-29 17:31:28 +02:00