Julian Risch 54f776350c

Update evaluation tutorial to cover the new pipeline.eval() (#1765) ...

* Replace old tutorial 5 with new code based on test cases

* Add latest docstring and tutorial changes

* Use pipeline.eval() in tutorial

* Add latest docstring and tutorial changes

* Restructure notebook

* Add latest docstring and tutorial changes

* Add dataframe example

* Add latest docstring and tutorial changes

* Get eval data from doc store

* Add latest docstring and tutorial changes

* Load data from doc store

* Add latest docstring and tutorial changes

* Clear outputs

* Add latest docstring and tutorial changes

* Change example and add python script

* Add latest docstring and tutorial changes

* Fetch aggregated multilabels from doc store

* Add latest docstring and tutorial changes

* Incorporate review feedback on text comments

* Add latest docstring and tutorial changes

* Add Notebook output

* Remove queries param from pipeline.eval()

* Add latest docstring and tutorial changes

* Add output with all metrics

* Add printing of multiple metrics to script

* Add latest docstring and tutorial changes

Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>

2021-12-03 11:19:41 +01:00

..

small_faq_covid.csv

Add eval for Dense Passage Retriever & Refactor handling of labels/feedback (#243)

2020-07-31 11:34:06 +02:00

small_generator_dataset.csv

[RAG] Integrate "Retrieval-Augmented Generation" with Haystack (#484)

2020-10-30 18:06:02 +01:00

Tutorial1_Basic_QA_Pipeline.ipynb

Improve tutorials' output (#1694)

2021-11-09 15:09:26 +01:00

Tutorial1_Basic_QA_Pipeline.py

Improve tutorials' output (#1694)

2021-11-09 15:09:26 +01:00

Tutorial2_Finetune_a_model_on_your_data.ipynb

Refactoring of the haystack package (#1624)

2021-10-25 15:50:23 +02:00

Tutorial2_Finetune_a_model_on_your_data.py

Refactoring of the haystack package (#1624)

2021-10-25 15:50:23 +02:00

Tutorial3_Basic_QA_Pipeline_without_Elasticsearch.ipynb

Improve tutorials' output (#1694)

2021-11-09 15:09:26 +01:00

Tutorial3_Basic_QA_Pipeline_without_Elasticsearch.py

Improve tutorials' output (#1694)

2021-11-09 15:09:26 +01:00

Tutorial4_FAQ_style_QA.ipynb

Improve tutorials' output (#1694)

2021-11-09 15:09:26 +01:00

Tutorial4_FAQ_style_QA.py

Improve tutorials' output (#1694)

2021-11-09 15:09:26 +01:00

Tutorial5_Evaluation.ipynb

Update evaluation tutorial to cover the new pipeline.eval() (#1765)

2021-12-03 11:19:41 +01:00

Tutorial5_Evaluation.py

Update evaluation tutorial to cover the new pipeline.eval() (#1765)

2021-12-03 11:19:41 +01:00

Tutorial6_Better_Retrieval_via_DPR.ipynb

Refactoring of the haystack package (#1624)

2021-10-25 15:50:23 +02:00

Tutorial6_Better_Retrieval_via_DPR.py

Improve tutorials' output (#1694)

2021-11-09 15:09:26 +01:00

Tutorial7_RAG_Generator.ipynb

Improve tutorials' output (#1694)

2021-11-09 15:09:26 +01:00

Tutorial7_RAG_Generator.py

Improve tutorials' output (#1694)

2021-11-09 15:09:26 +01:00

Tutorial8_Preprocessing.ipynb

Add AzureConverter to support table parsing from documents (#1813)

2021-11-29 18:44:20 +01:00

Tutorial8_Preprocessing.py

Add AzureConverter to support table parsing from documents (#1813)

2021-11-29 18:44:20 +01:00

Tutorial9_DPR_training.ipynb

Refactoring of the haystack package (#1624)

2021-10-25 15:50:23 +02:00

Tutorial9_DPR_training.py

Refactoring of the haystack package (#1624)

2021-10-25 15:50:23 +02:00

Tutorial10_Knowledge_Graph.ipynb

Refactoring of the haystack package (#1624)

2021-10-25 15:50:23 +02:00

Tutorial10_Knowledge_Graph.py

Fix a few details of some tutorials (#1733)

2021-11-12 16:44:28 +01:00

Tutorial11_Pipelines.ipynb

Fix Tutorial 11 on Google Colab (#1795)

2021-11-23 15:35:23 +01:00

Tutorial11_Pipelines.py

Fix a few details of some tutorials (#1733)

2021-11-12 16:44:28 +01:00

Tutorial12_LFQA.ipynb

Refactoring of the haystack package (#1624)

2021-10-25 15:50:23 +02:00

Tutorial12_LFQA.py

Improve tutorials' output (#1694)

2021-11-09 15:09:26 +01:00

Tutorial13_Question_generation.ipynb

Improve tutorials' output (#1694)

2021-11-09 15:09:26 +01:00

Tutorial13_Question_generation.py

Improve tutorials' output (#1694)

2021-11-09 15:09:26 +01:00

Tutorial14_Query_Classifier.ipynb

Improve tutorials' output (#1694)

2021-11-09 15:09:26 +01:00

Tutorial14_Query_Classifier.py

Improve tutorials' output (#1694)

2021-11-09 15:09:26 +01:00

Tutorial15_TableQA.ipynb

Upgrade torch to v1.10.0 (#1789)

2021-11-23 11:49:46 +01:00

Tutorial15_TableQA.py

Fix a few details of some tutorials (#1733)

2021-11-12 16:44:28 +01:00

Tutorial16_Document_Classifier_at_Index_Time.ipynb

Fix link to colab notebook in tutorial 16 (#1802)

2021-11-24 13:19:20 +01:00

Tutorial16_Document_Classifier_at_Index_Time.py

Tutorial for DocumentClassifier at Index Time (#1697)

2021-11-09 18:43:00 +01:00