140 Commits

Author SHA1 Message Date
Malte Pietsch
ff1adb64c2
Update README.md 2021-09-21 17:56:40 +02:00
oryx1729
9dd7c74f4f
Refactor communication between Pipeline Components (#1321) 2021-09-10 11:41:16 +02:00
Bob van Luijt
c0cc8bc80f
Bump Weaviate version to 1.7.0 (#1412)
* Bump Weaviate

* Bump Weaviate

* Bump Weaviate client

* Bump Weaviate

* Revert client version

There is a change in the client API that needs to be addressed before bumping its version
2021-09-05 09:28:55 +02:00
Malte Pietsch
f3d1df1664
Enable docker-compose for GPUs & Add public UI image (#1406)
* add docker-compose-gpu file

* Update README.md

* Update docker-compose.yml

* Update docker-compose-gpu.yml

* Update docker-compose.yml

* Update docker-compose-gpu.yml
2021-09-02 17:39:21 +02:00
Shahrukh Khan
4822536886
Add ImageToTextConverter and PDFToTextOCRConverter that utilize OCR (#1349)
* add image.py converter

* add PDFtoImageConverter

* add init to PDFtoImageConverter and classes to __init__

* update imagetotext pipeline

* update imagetotext pipeline

* update imagetotext pipeline

* update imagetotext pipeline

* update imagetotext pipeline

* update imagetotext pipeline

* update imagetotext pipeline

* revert change in base.py in file_conv

* Update base.py

* Update pdf.py

* add ocr file_converter testcase & update dockerfile

* fix tesseract exception message typo

* fix _image_to_text doctstring

* add tesseract installation to CI

* add tesseract installation to CI

* add content test for PDF OCR converter

* update PDFToTextOCRConverter constructor doctsring

* replace image files with tmp paths for image.py convert

* replace image files with tmp paths for image.py convert

* Update README.md

Co-authored-by: Malte Pietsch <malte.pietsch@deepset.ai>
2021-09-01 16:42:25 +02:00
Markus Paff
be8d305190
Editing docs read.me for new docs website workflow (#1372)
* editing docs read.me for new docs website workflow

* added new links to docs
2021-08-30 14:59:40 +02:00
annagruendler
a3c746abf5
Update test documentation in readme (#1355) 2021-08-19 10:36:21 +02:00
Tanay Pant
79df82aec6
Remove empty bullet points (#1342) 2021-08-12 20:09:18 +02:00
Malte Pietsch
66b10a508b
Update TOC of readme 2021-08-09 11:40:20 +02:00
Malte Pietsch
fb4d6e0381
Update README.md 2021-08-09 11:25:47 +02:00
Malte Pietsch
5a3ea5843f
Fix Tutorial Links 2021-08-09 11:22:19 +02:00
Shahrukh Khan
f99c14268a
Update README.md for new tutorials 13 and 14 (#1325)
* Update README.md

* Update README.md
2021-08-09 10:44:42 +02:00
Julian Risch
90f826e95e
Add links to tutorial 12 to readme (#1274) 2021-07-13 11:23:10 +02:00
Malte Pietsch
600636e77b
Update README.md 2021-06-08 09:23:56 +02:00
Malte Pietsch
a1472b040c
Add badges (#1136) 2021-06-03 14:47:08 +02:00
Julian Risch
84c34295a1
Re-ranking component for document search without QA (#1025)
* Adding ranker similar to retriever and reader

* Sort documents according to query-document similarity scores

* Reranking and model training runs for small example

* Added EvalRanker node

* Calculate recall@k in EvalRetriever and EvalRanker nodes

* Renaming EvalRetriever to EvalDocuments and EvalReader to EvalAnswers

* Added mean reciprocal rank as metric for EvalDocuments

* Fix bug that appeared when ranking documents with same score

* Remove commented code for unimplmented eval() of Ranker node

* Add documentation of k parameter in EvalDocuments

* Add Ranker docu and renaming top_k param
2021-05-31 15:31:36 +02:00
Branden Chan
aadd8b049a
Add Tutorial 11 to Readme 2021-05-05 15:35:21 +02:00
Andrey A
58ea0a62e0
Add links to GitHub Discussion and SO (#984)
* Add link to Stack Overflow

* Add link to GitHub discussions and re-arrange links
2021-04-22 09:51:21 +02:00
Julian Risch
8333a13d6f
Adding tutorial on knowledge graphs to README 2021-04-12 15:26:02 +02:00
Lalit Pagaria
e904deefa7
Add Markdown file convertor (#875) 2021-03-23 16:31:26 +01:00
Peter Demin
992277e812
Run Grammarly over README.md (#890)
* Run Grammarly over README.md

* Update README.md

Co-authored-by: Andrey A. <56412611+aantti@users.noreply.github.com>

* Update README.md

Co-authored-by: Andrey A. <56412611+aantti@users.noreply.github.com>

* Update README.md

Co-authored-by: Andrey A. <56412611+aantti@users.noreply.github.com>

* Update README.md

Co-authored-by: Andrey A. <56412611+aantti@users.noreply.github.com>

* Update README.md

Co-authored-by: Andrey A. <56412611+aantti@users.noreply.github.com>

* Update README.md

Co-authored-by: Andrey A. <56412611+aantti@users.noreply.github.com>

* Update README.md

Co-authored-by: Andrey A. <56412611+aantti@users.noreply.github.com>
2021-03-16 18:00:57 +03:00
Branden Chan
a6a3b74199
Fix image in README 2021-02-16 17:05:15 +01:00
Andrey A
e0be5639ef
Update README.md 2021-02-16 18:47:14 +03:00
Andrey A
ab89fac76a
Update README.md 2021-02-16 18:45:20 +03:00
Andrey A
5c9f7d493c
Fix link to Quick Demo in ToC. (#831) 2021-02-16 16:38:04 +01:00
Branden Chan
7030c94325
Revamp Readme (#820)
* Text changes

* Add new images

* First improvements

* Next iteration

* Resize gif

* Add bold

* Update key concepts diagram

* Center image

* Initial import of a more detailed README.md

* Slight changes to ToC, requirements and across the text.

* Grammar and Streamlit UI png.

* Unfix size of gif for mobile

* Remove requirements, add formatting to numbered lists.

* Formatting, remove img size options.

* Another iteration of phrasing the note about open ports.

* Rephrase the note about the docker ports.

Co-authored-by: Andrey A <56412611+aantti@users.noreply.github.com>
2021-02-16 15:32:43 +01:00
Andrey A
7a0b65a079
Add links to slack, twitter etc (#746)
* Update README.md
2021-01-19 11:30:26 +01:00
Branden Chan
7376185b65
Create DPR training tutorial (#708)
* WIP: Start DPR training tutorial

* Create basics of DPR Train tutorial

* Update documentation

* Allow DPR to be initialized without document store

* WIP: Add param descriptions to DPR notebook

* Clean tutorial

* Improve loading

* Make doc store optional when loading DPR

* Satisfy mypy type check

* Add links

* Add tutorial header

* Add colab badge

* Clear outputs

* Incorporate reviewer feedback

* WIP: Start DPR training tutorial

* Create basics of DPR Train tutorial

* Update documentation

* Allow DPR to be initialized without document store

* WIP: Add param descriptions to DPR notebook

* Clean tutorial

* Improve loading

* Make doc store optional when loading DPR

* Satisfy mypy type check

* Add links

* Add tutorial header

* Add colab badge

* Clear outputs

* Incorporate reviewer feedback

* Add readme links

* Regenerate tutorials

* Add excitement

* Fix typo

* Fix hard negatives comment

* Wrap tutorial for windows users

* Fix mypy issue
2021-01-13 10:33:55 +01:00
Lalit Pagaria
88b5cbe736
Correcting pypi download badge (#722) 2021-01-10 06:26:17 +01:00
Malte Pietsch
a284af3ae5
Remove sourcerer.io widget (#702)
Fix #699
2020-12-30 09:57:02 +01:00
Lalit Pagaria
fc521fe293
Haystack logo is not visible on github mobile. Adding download badge. (#697) 2020-12-27 12:58:48 +01:00
Malte Pietsch
737a47e2fe
Update readme 2020-12-26 12:14:52 +01:00
Malte Pietsch
a2e5e6b09e
Update pipeline documentation and readme (#693)
* Update README.md

* Update pipelines.md

* Update pipelines.md

* Update README.md
2020-12-22 13:34:28 +01:00
Branden Chan
79555148ac
Add link to FAISS Info in documentation (#643)
* Add link to FAISS info

* Clean link
2020-12-02 15:24:22 +01:00
Malte Pietsch
58bc9aa7f0
Add contributor hall of fame (#628) 2020-11-26 14:52:20 +01:00
Ky-Anh Huynh
4bd4a61e65
README: Fix link to roadmap (#626)
Co-authored-by: Ky-Anh Huynh <kyanh.huynh@viettug.org>
2020-11-26 14:01:05 +01:00
Branden Chan
e192387e65
Fix link (#613) 2020-11-24 11:11:20 +01:00
Branden Chan
1e8af84ecc
Make more changes to documentation (#578)
* First batch of changes

* Add RAG tutorial links

* Prettify RAG tutorial

* draft of generator doc

* Add text

* Complete generator page

* Create optimization section

* Split intro

* Fix formatting tutorial 7
2020-11-19 14:58:27 +01:00
Malte Pietsch
2b352d6ac4
Update concept image 2020-11-07 08:44:09 +01:00
Malte Pietsch
c363fefc6e
New readme (#534)
* WIP readme to md

* Update README.md

* Update README.md

* Update README.md

* Update README.md

* Update README.md

* Update README.md

* Update README.md

* Update README.md

* Update README.md

* Update README.md

* delete rst readme
2020-11-02 20:03:22 +01:00