Timo Moeller efc754b166

Redone: Fix concatenation of sentences in PreProcessor. Add stride for word-based splits with sentence boundaries (#641) ...

* Update preprocessor.py

Concatenation of sentences done correctly. Stride functionality enabled for splitting by words while respecting sentence boundaries.

* Simplify code, add test

Co-authored-by: Krak91 <45461739+Krak91@users.noreply.github.com>

2020-12-09 16:12:36 +01:00

..

benchmarks

Fix benchmarks (#648)

2020-12-02 16:59:42 +01:00

samples

Add eval for Dense Passage Retriever & Refactor handling of labels/feedback (#243)

2020-07-31 11:34:06 +02:00

conftest.py

Enable dynamic parameter updates for the FARMReader (#650)

2020-12-07 14:07:20 +01:00

pytest.ini

Add pipelines for GenerativeQA & FAQs (#645)

2020-12-03 10:27:06 +01:00

test_db.py

Add pipelines for GenerativeQA & FAQs (#645)

2020-12-03 10:27:06 +01:00

test_document.py

Rename and restructure modules (database, indexing, schemas) (#379)

2020-09-16 18:33:23 +02:00

test_docx_conversion.py

[RAG] Integrate "Retrieval-Augmented Generation" with Haystack (#484)

2020-10-30 18:06:02 +01:00

test_dpr_retriever.py

Add return_embedding parameter for get_all_documents() (#615)

2020-11-26 10:32:30 +01:00

test_dummy_retriever.py

[RAG] Integrate "Retrieval-Augmented Generation" with Haystack (#484)

2020-10-30 18:06:02 +01:00

test_elastic_dsl_convertor.py

Add Elasticsearch Query DSL compliant Query API (#471)

2020-10-16 13:25:31 +02:00

test_elastic_retriever.py

[RAG] Integrate "Retrieval-Augmented Generation" with Haystack (#484)

2020-10-30 18:06:02 +01:00

test_embedding_retriever.py

[RAG] Integrate "Retrieval-Augmented Generation" with Haystack (#484)

2020-10-30 18:06:02 +01:00

test_eval.py

Fix retriever evaluation metrics (#547)

2020-11-05 13:34:47 +01:00

test_faiss.py

Add pipelines for GenerativeQA & FAQs (#645)

2020-12-03 10:27:06 +01:00

test_finder.py

Rename question parameter to query (#614)

2020-11-30 17:50:04 +01:00

test_generator.py

Add pipelines for GenerativeQA & FAQs (#645)

2020-12-03 10:27:06 +01:00

test_imports.py

Rename and restructure modules (database, indexing, schemas) (#379)

2020-09-16 18:33:23 +02:00

test_pdf_conversion.py

[RAG] Integrate "Retrieval-Augmented Generation" with Haystack (#484)

2020-10-30 18:06:02 +01:00

test_pipeline.py

Add pipelines for GenerativeQA & FAQs (#645)

2020-12-03 10:27:06 +01:00

test_preprocessor.py

Redone: Fix concatenation of sentences in PreProcessor. Add stride for word-based splits with sentence boundaries (#641)

2020-12-09 16:12:36 +01:00

test_reader.py

Enable dynamic parameter updates for the FARMReader (#650)

2020-12-07 14:07:20 +01:00

test_rest_api.py

Allow list of filter values in REST API (#568)

2020-11-09 20:41:53 +01:00

test_tfidf_retriever.py

[RAG] Integrate "Retrieval-Augmented Generation" with Haystack (#484)

2020-10-30 18:06:02 +01:00

test_utils.py

[RAG] Integrate "Retrieval-Augmented Generation" with Haystack (#484)

2020-10-30 18:06:02 +01:00