yujunjun/haystack
1
0
Fork 0
mirror of https://github.com/deepset-ai/haystack.git synced 2025-08-26 01:16:20 +00:00
Code Issues Packages Projects Releases Wiki Activity

Add comment to tutorial notebooks about restarting runtime in colab (#1486)

Browse Source 
* Add comment to tutorial notebooks about restarting runtime in colab

* Add latest docstring and tutorial changes

Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
This commit is contained in:
bogdankostic 2021-09-23 14:36:20 +02:00 committed by GitHub
parent 34a8879f60
commit c644e2b4d0
No known key found for this signature in database
GPG Key ID: 4AEE18F83AFDEB23
28 changed files with 229 additions and 217 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2
docs/_src/tutorials/tutorials/1.md
View File

@ -45,6 +45,8 @@ Make sure you enable the GPU runtime to experience decent speed in this tutorial
!pip install grpcio-tools==1.34.1
!pip install git+https://github.com/deepset-ai/haystack.git
# If you run this notebook on Google Colab, you might need to
# restart the runtime after installing haystack.
```

3
docs/_src/tutorials/tutorials/10.md
View File

@ -23,6 +23,9 @@ The training of models that translate text queries into SPARQL queries is curren
# Install the latest master of Haystack
!pip install grpcio-tools==1.34.1
!pip install git+https://github.com/deepset-ai/haystack.git
# If you run this notebook on Google Colab, you might need to
# restart the runtime after installing haystack.
```

3
docs/_src/tutorials/tutorials/11.md
View File

@ -43,6 +43,9 @@ These lines are to install Haystack through pip
# Install pygraphviz
!apt install libgraphviz-dev
!pip install pygraphviz
# If you run this notebook on Google Colab, you might need to
# restart the runtime after installing haystack.
```
If running from Colab or a no Docker environment, you will want to start Elasticsearch from source

3
docs/_src/tutorials/tutorials/12.md
View File

@ -29,6 +29,9 @@ Make sure you enable the GPU runtime to experience decent speed in this tutorial
```python
# Install the latest master of Haystack
!pip install git+https://github.com/deepset-ai/haystack.git
# If you run this notebook on Google Colab, you might need to
# restart the runtime after installing haystack.
```

3
docs/_src/tutorials/tutorials/13.md
View File

@ -20,6 +20,9 @@ generate questions which the question generation model thinks can be answered by
!pip install grpcio-tools==1.34.1
!pip install git+https://github.com/deepset-ai/haystack.git
# If you run this notebook on Google Colab, you might need to
# restart the runtime after installing haystack.
```

2
docs/_src/tutorials/tutorials/14.md
View File

@ -65,6 +65,8 @@ These lines are to install Haystack through pip
!apt install libgraphviz-dev
!pip install pygraphviz
# If you run this notebook on Google Colab, you might need to
# restart the runtime after installing haystack.
# In Colab / No Docker environments: Start Elasticsearch from source
! wget https://artifacts.elastic.co/downloads/elasticsearch/elasticsearch-7.9.2-linux-x86_64.tar.gz -q

2
docs/_src/tutorials/tutorials/2.md
View File

@ -40,6 +40,8 @@ Make sure you enable the GPU runtime to experience decent speed in this tutorial
!pip install grpcio-tools==1.34.1
!pip install git+https://github.com/deepset-ai/haystack.git
# If you run this notebook on Google Colab, you might need to
# restart the runtime after installing haystack.
```

2
docs/_src/tutorials/tutorials/3.md
View File

@ -40,6 +40,8 @@ Make sure you enable the GPU runtime to experience decent speed in this tutorial
!pip install grpcio-tools==1.34.1
!pip install git+https://github.com/deepset-ai/haystack.git
# If you run this notebook on Google Colab, you might need to
# restart the runtime after installing haystack.
```

2
docs/_src/tutorials/tutorials/4.md
View File

@ -48,6 +48,8 @@ Make sure you enable the GPU runtime to experience decent speed in this tutorial
!pip install grpcio-tools==1.34.1
!pip install git+https://github.com/deepset-ai/haystack.git
# If you run this notebook on Google Colab, you might need to
# restart the runtime after installing haystack.
```

2
docs/_src/tutorials/tutorials/5.md
View File

@ -39,6 +39,8 @@ You can start Elasticsearch on your local machine instance using Docker. If Dock
!pip install grpcio-tools==1.34.1
!pip install git+https://github.com/deepset-ai/haystack.git
# If you run this notebook on Google Colab, you might need to
# restart the runtime after installing haystack.
```

2
docs/_src/tutorials/tutorials/6.md
View File

@ -81,6 +81,8 @@ Make sure you enable the GPU runtime to experience decent speed in this tutorial
!pip install grpcio-tools==1.34.1
!pip install git+https://github.com/deepset-ai/haystack.git
# If you run this notebook on Google Colab, you might need to
# restart the runtime after installing haystack.
```

2
docs/_src/tutorials/tutorials/7.md
View File

@ -38,6 +38,8 @@ Here are the packages and imports that we'll need:
!pip install grpcio-tools==1.34.1
!pip install git+https://github.com/deepset-ai/haystack.git
# If you run this notebook on Google Colab, you might need to
# restart the runtime after installing haystack.
```

3
docs/_src/tutorials/tutorials/8.md
View File

@ -39,6 +39,9 @@ This tutorial will show you all the tools that Haystack provides to help you cas
!pip install git+https://github.com/deepset-ai/haystack.git
!wget --no-check-certificate https://dl.xpdfreader.com/xpdf-tools-linux-4.03.tar.gz
!tar -xvf xpdf-tools-linux-4.03.tar.gz && sudo cp xpdf-tools-linux-4.03/bin64/pdftotext /usr/local/bin
# If you run this notebook on Google Colab, you might need to
# restart the runtime after installing haystack.
```

3
docs/_src/tutorials/tutorials/9.md
View File

@ -22,6 +22,9 @@ This tutorial will guide you through the steps required to create a retriever th
# Install the latest master of Haystack
!pip install grpcio-tools==1.34.1
!pip install git+https://github.com/deepset-ai/haystack.git
# If you run this notebook on Google Colab, you might need to
# restart the runtime after installing haystack.
```

14
tutorials/Tutorial10_Knowledge_Graph.ipynb
View File

@ -28,7 +28,10 @@
"\n",
"# Install the latest master of Haystack\n",
"!pip install grpcio-tools==1.34.1\n",
"!pip install git+https://github.com/deepset-ai/haystack.git"
"!pip install git+https://github.com/deepset-ai/haystack.git\n",
"\n",
"# If you run this notebook on Google Colab, you might need to\n",
"# restart the runtime after installing haystack."
],
"metadata": {
"collapsed": false,
@ -279,15 +282,6 @@
"nbconvert_exporter": "python",
"pygments_lexer": "ipython2",
"version": "2.7.6"
},
"pycharm": {
"stem_cell": {
"cell_type": "raw",
"source": [],
"metadata": {
"collapsed": false
}
}
}
},
"nbformat": 4,

16
tutorials/Tutorial11_Pipelines.ipynb
View File

@ -76,7 +76,10 @@
"\n",
"# Install pygraphviz\n",
"!apt install libgraphviz-dev\n",
"!pip install pygraphviz"
"!pip install pygraphviz\n",
"\n",
"# If you run this notebook on Google Colab, you might need to\n",
"# restart the runtime after installing haystack."
],
"metadata": {
"collapsed": false,
@ -745,17 +748,8 @@
"nbconvert_exporter": "python",
"pygments_lexer": "ipython2",
"version": "2.7.6"
},
"pycharm": {
"stem_cell": {
"cell_type": "raw",
"source": [],
"metadata": {
"collapsed": false
}
}
}
},
"nbformat": 4,
"nbformat_minor": 0
}
}

5
tutorials/Tutorial12_LFQA.ipynb
View File

@ -72,7 +72,10 @@
},
"source": [
"# Install the latest master of Haystack\n",
"!pip install git+https://github.com/deepset-ai/haystack.git"
"!pip install git+https://github.com/deepset-ai/haystack.git\n",
"\n",
"# If you run this notebook on Google Colab, you might need to\n",
"# restart the runtime after installing haystack."
],
"execution_count": null,
"outputs": []

14
tutorials/Tutorial13_Question_generation.ipynb
View File

@ -25,7 +25,10 @@
"# Install needed libraries\n",
"\n",
"!pip install grpcio-tools==1.34.1\n",
"!pip install git+https://github.com/deepset-ai/haystack.git"
"!pip install git+https://github.com/deepset-ai/haystack.git\n",
"\n",
"# If you run this notebook on Google Colab, you might need to\n",
"# restart the runtime after installing haystack."
],
"metadata": {
"collapsed": false,
@ -287,15 +290,6 @@
"nbconvert_exporter": "python",
"pygments_lexer": "ipython2",
"version": "2.7.6"
},
"pycharm": {
"stem_cell": {
"cell_type": "raw",
"source": [],
"metadata": {
"collapsed": false
}
}
}
},
"nbformat": 4,

289
tutorials/Tutorial14_Query_Classifier.ipynb
View File

@ -95,8 +95,8 @@
"text": [
"Collecting grpcio-tools==1.34.1\n",
" Downloading grpcio_tools-1.34.1-cp37-cp37m-manylinux2014_x86_64.whl (2.5 MB)\n",
"\u001b[K |████████████████████████████████| 2.5 MB 7.7 MB/s \n",
"\u001b[?25hRequirement already satisfied: grpcio>=1.34.1 in /usr/local/lib/python3.7/dist-packages (from grpcio-tools==1.34.1) (1.34.1)\n",
"\u001B[K |████████████████████████████████| 2.5 MB 7.7 MB/s \n",
"\u001B[?25hRequirement already satisfied: grpcio>=1.34.1 in /usr/local/lib/python3.7/dist-packages (from grpcio-tools==1.34.1) (1.34.1)\n",
"Requirement already satisfied: protobuf<4.0dev,>=3.5.0.post1 in /usr/local/lib/python3.7/dist-packages (from grpcio-tools==1.34.1) (3.17.3)\n",
"Requirement already satisfied: setuptools in /usr/local/lib/python3.7/dist-packages (from grpcio-tools==1.34.1) (57.2.0)\n",
"Requirement already satisfied: six>=1.5.2 in /usr/local/lib/python3.7/dist-packages (from grpcio>=1.34.1->grpcio-tools==1.34.1) (1.15.0)\n",
@ -107,140 +107,140 @@
" Running command git clone -q https://github.com/deepset-ai/haystack.git /tmp/pip-req-build-dq33uzal\n",
"Collecting farm==0.8.0\n",
" Downloading farm-0.8.0-py3-none-any.whl (204 kB)\n",
"\u001b[K |████████████████████████████████| 204 kB 8.3 MB/s \n",
"\u001b[?25hCollecting fastapi\n",
"\u001B[K |████████████████████████████████| 204 kB 8.3 MB/s \n",
"\u001B[?25hCollecting fastapi\n",
" Downloading fastapi-0.68.0-py3-none-any.whl (52 kB)\n",
"\u001b[K |████████████████████████████████| 52 kB 984 kB/s \n",
"\u001b[?25hCollecting uvicorn\n",
"\u001B[K |████████████████████████████████| 52 kB 984 kB/s \n",
"\u001B[?25hCollecting uvicorn\n",
" Downloading uvicorn-0.14.0-py3-none-any.whl (50 kB)\n",
"\u001b[K |████████████████████████████████| 50 kB 8.1 MB/s \n",
"\u001b[?25hCollecting gunicorn\n",
"\u001B[K |████████████████████████████████| 50 kB 8.1 MB/s \n",
"\u001B[?25hCollecting gunicorn\n",
" Downloading gunicorn-20.1.0-py3-none-any.whl (79 kB)\n",
"\u001b[K |████████████████████████████████| 79 kB 9.4 MB/s \n",
"\u001b[?25hRequirement already satisfied: pandas in /usr/local/lib/python3.7/dist-packages (from farm-haystack==0.9.0) (1.1.5)\n",
"\u001B[K |████████████████████████████████| 79 kB 9.4 MB/s \n",
"\u001B[?25hRequirement already satisfied: pandas in /usr/local/lib/python3.7/dist-packages (from farm-haystack==0.9.0) (1.1.5)\n",
"Requirement already satisfied: sklearn in /usr/local/lib/python3.7/dist-packages (from farm-haystack==0.9.0) (0.0)\n",
"Collecting elasticsearch<=7.10,>=7.7\n",
" Downloading elasticsearch-7.10.0-py2.py3-none-any.whl (321 kB)\n",
"\u001b[K |████████████████████████████████| 321 kB 38.6 MB/s \n",
"\u001b[?25hCollecting elastic-apm\n",
"\u001B[K |████████████████████████████████| 321 kB 38.6 MB/s \n",
"\u001B[?25hCollecting elastic-apm\n",
" Downloading elastic_apm-6.3.3-cp37-cp37m-manylinux2010_x86_64.whl (330 kB)\n",
"\u001b[K |████████████████████████████████| 330 kB 34.8 MB/s \n",
"\u001b[?25hCollecting tox\n",
"\u001B[K |████████████████████████████████| 330 kB 34.8 MB/s \n",
"\u001B[?25hCollecting tox\n",
" Downloading tox-3.24.1-py2.py3-none-any.whl (85 kB)\n",
"\u001b[K |████████████████████████████████| 85 kB 5.7 MB/s \n",
"\u001b[?25hRequirement already satisfied: coverage in /usr/local/lib/python3.7/dist-packages (from farm-haystack==0.9.0) (3.7.1)\n",
"\u001B[K |████████████████████████████████| 85 kB 5.7 MB/s \n",
"\u001B[?25hRequirement already satisfied: coverage in /usr/local/lib/python3.7/dist-packages (from farm-haystack==0.9.0) (3.7.1)\n",
"Collecting langdetect\n",
" Downloading langdetect-1.0.9.tar.gz (981 kB)\n",
"\u001b[K |████████████████████████████████| 981 kB 40.1 MB/s \n",
"\u001b[?25hCollecting python-multipart\n",
"\u001B[K |████████████████████████████████| 981 kB 40.1 MB/s \n",
"\u001B[?25hCollecting python-multipart\n",
" Downloading python-multipart-0.0.5.tar.gz (32 kB)\n",
"Collecting python-docx\n",
" Downloading python-docx-0.8.11.tar.gz (5.6 MB)\n",
"\u001b[K |████████████████████████████████| 5.6 MB 45.6 MB/s \n",
"\u001b[?25hRequirement already satisfied: sqlalchemy>=1.4.2 in /usr/local/lib/python3.7/dist-packages (from farm-haystack==0.9.0) (1.4.20)\n",
"\u001B[K |████████████████████████████████| 5.6 MB 45.6 MB/s \n",
"\u001B[?25hRequirement already satisfied: sqlalchemy>=1.4.2 in /usr/local/lib/python3.7/dist-packages (from farm-haystack==0.9.0) (1.4.20)\n",
"Collecting sqlalchemy_utils\n",
" Downloading SQLAlchemy_Utils-0.37.8-py3-none-any.whl (100 kB)\n",
"\u001b[K |████████████████████████████████| 100 kB 11.8 MB/s \n",
"\u001b[?25hCollecting faiss-cpu>=1.6.3\n",
"\u001B[K |████████████████████████████████| 100 kB 11.8 MB/s \n",
"\u001B[?25hCollecting faiss-cpu>=1.6.3\n",
" Downloading faiss_cpu-1.7.1.post2-cp37-cp37m-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (8.4 MB)\n",
"\u001b[K |████████████████████████████████| 8.4 MB 28.1 MB/s \n",
"\u001b[?25hCollecting tika\n",
"\u001B[K |████████████████████████████████| 8.4 MB 28.1 MB/s \n",
"\u001B[?25hCollecting tika\n",
" Downloading tika-1.24.tar.gz (28 kB)\n",
"Collecting httptools\n",
" Downloading httptools-0.2.0-cp37-cp37m-manylinux1_x86_64.whl (344 kB)\n",
"\u001b[K |████████████████████████████████| 344 kB 57.6 MB/s \n",
"\u001b[?25hRequirement already satisfied: nltk in /usr/local/lib/python3.7/dist-packages (from farm-haystack==0.9.0) (3.2.5)\n",
"\u001B[K |████████████████████████████████| 344 kB 57.6 MB/s \n",
"\u001B[?25hRequirement already satisfied: nltk in /usr/local/lib/python3.7/dist-packages (from farm-haystack==0.9.0) (3.2.5)\n",
"Requirement already satisfied: more_itertools in /usr/local/lib/python3.7/dist-packages (from farm-haystack==0.9.0) (8.8.0)\n",
"Requirement already satisfied: networkx in /usr/local/lib/python3.7/dist-packages (from farm-haystack==0.9.0) (2.5.1)\n",
"Collecting pymilvus\n",
" Downloading pymilvus-1.1.2-py3-none-any.whl (56 kB)\n",
"\u001b[K |████████████████████████████████| 56 kB 5.3 MB/s \n",
"\u001b[?25hCollecting SPARQLWrapper\n",
"\u001B[K |████████████████████████████████| 56 kB 5.3 MB/s \n",
"\u001B[?25hCollecting SPARQLWrapper\n",
" Downloading SPARQLWrapper-1.8.5-py3-none-any.whl (26 kB)\n",
"Collecting mmh3\n",
" Downloading mmh3-3.0.0-cp37-cp37m-manylinux2010_x86_64.whl (50 kB)\n",
"\u001b[K |████████████████████████████████| 50 kB 7.4 MB/s \n",
"\u001b[?25hCollecting weaviate-client==2.5.0\n",
"\u001B[K |████████████████████████████████| 50 kB 7.4 MB/s \n",
"\u001B[?25hCollecting weaviate-client==2.5.0\n",
" Downloading weaviate_client-2.5.0-py3-none-any.whl (56 kB)\n",
"\u001b[K |████████████████████████████████| 56 kB 5.9 MB/s \n",
"\u001b[?25hCollecting ray==1.5.0\n",
"\u001B[K |████████████████████████████████| 56 kB 5.9 MB/s \n",
"\u001B[?25hCollecting ray==1.5.0\n",
" Downloading ray-1.5.0-cp37-cp37m-manylinux2014_x86_64.whl (51.5 MB)\n",
"\u001b[K |████████████████████████████████| 51.5 MB 20 kB/s \n",
"\u001b[?25hCollecting psycopg2-binary\n",
"\u001B[K |████████████████████████████████| 51.5 MB 20 kB/s \n",
"\u001B[?25hCollecting psycopg2-binary\n",
" Downloading psycopg2_binary-2.9.1-cp37-cp37m-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (3.4 MB)\n",
"\u001b[K |████████████████████████████████| 3.4 MB 53.0 MB/s \n",
"\u001b[?25hCollecting uvloop==0.14\n",
"\u001B[K |████████████████████████████████| 3.4 MB 53.0 MB/s \n",
"\u001B[?25hCollecting uvloop==0.14\n",
" Downloading uvloop-0.14.0-cp37-cp37m-manylinux2010_x86_64.whl (3.8 MB)\n",
"\u001b[K |████████████████████████████████| 3.8 MB 49.1 MB/s \n",
"\u001b[?25hCollecting flask-restplus\n",
"\u001B[K |████████████████████████████████| 3.8 MB 49.1 MB/s \n",
"\u001B[?25hCollecting flask-restplus\n",
" Downloading flask_restplus-0.13.0-py2.py3-none-any.whl (2.5 MB)\n",
"\u001b[K |████████████████████████████████| 2.5 MB 48.6 MB/s \n",
"\u001b[?25hRequirement already satisfied: scipy>=1.3.2 in /usr/local/lib/python3.7/dist-packages (from farm==0.8.0->farm-haystack==0.9.0) (1.4.1)\n",
"\u001B[K |████████████████████████████████| 2.5 MB 48.6 MB/s \n",
"\u001B[?25hRequirement already satisfied: scipy>=1.3.2 in /usr/local/lib/python3.7/dist-packages (from farm==0.8.0->farm-haystack==0.9.0) (1.4.1)\n",
"Collecting transformers==4.6.1\n",
" Downloading transformers-4.6.1-py3-none-any.whl (2.2 MB)\n",
"\u001b[K |████████████████████████████████| 2.2 MB 50.0 MB/s \n",
"\u001b[?25hRequirement already satisfied: setuptools in /usr/local/lib/python3.7/dist-packages (from farm==0.8.0->farm-haystack==0.9.0) (57.2.0)\n",
"\u001B[K |████████████████████████████████| 2.2 MB 50.0 MB/s \n",
"\u001B[?25hRequirement already satisfied: setuptools in /usr/local/lib/python3.7/dist-packages (from farm==0.8.0->farm-haystack==0.9.0) (57.2.0)\n",
"Requirement already satisfied: dill in /usr/local/lib/python3.7/dist-packages (from farm==0.8.0->farm-haystack==0.9.0) (0.3.4)\n",
"Requirement already satisfied: wheel in /usr/local/lib/python3.7/dist-packages (from farm==0.8.0->farm-haystack==0.9.0) (0.36.2)\n",
"Collecting sentencepiece\n",
" Downloading sentencepiece-0.1.96-cp37-cp37m-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (1.2 MB)\n",
"\u001b[K |████████████████████████████████| 1.2 MB 54.2 MB/s \n",
"\u001b[?25hRequirement already satisfied: psutil in /usr/local/lib/python3.7/dist-packages (from farm==0.8.0->farm-haystack==0.9.0) (5.4.8)\n",
"\u001B[K |████████████████████████████████| 1.2 MB 54.2 MB/s \n",
"\u001B[?25hRequirement already satisfied: psutil in /usr/local/lib/python3.7/dist-packages (from farm==0.8.0->farm-haystack==0.9.0) (5.4.8)\n",
"Requirement already satisfied: tqdm in /usr/local/lib/python3.7/dist-packages (from farm==0.8.0->farm-haystack==0.9.0) (4.41.1)\n",
"Requirement already satisfied: flask in /usr/local/lib/python3.7/dist-packages (from farm==0.8.0->farm-haystack==0.9.0) (1.1.4)\n",
"Requirement already satisfied: requests in /usr/local/lib/python3.7/dist-packages (from farm==0.8.0->farm-haystack==0.9.0) (2.23.0)\n",
"Collecting seqeval\n",
" Downloading seqeval-1.2.2.tar.gz (43 kB)\n",
"\u001b[K |████████████████████████████████| 43 kB 2.3 MB/s \n",
"\u001b[?25hCollecting boto3\n",
"\u001B[K |████████████████████████████████| 43 kB 2.3 MB/s \n",
"\u001B[?25hCollecting boto3\n",
" Downloading boto3-1.18.15.tar.gz (102 kB)\n",
"\u001b[K |████████████████████████████████| 102 kB 60.8 MB/s \n",
"\u001b[?25hCollecting dotmap\n",
"\u001B[K |████████████████████████████████| 102 kB 60.8 MB/s \n",
"\u001B[?25hCollecting dotmap\n",
" Downloading dotmap-1.3.24-py3-none-any.whl (11 kB)\n",
"Collecting flask-cors\n",
" Downloading Flask_Cors-3.0.10-py2.py3-none-any.whl (14 kB)\n",
"Collecting mlflow<=1.13.1\n",
" Downloading mlflow-1.13.1-py3-none-any.whl (14.1 MB)\n",
"\u001b[K |████████████████████████████████| 14.1 MB 29 kB/s \n",
"\u001b[?25hCollecting Werkzeug==0.16.1\n",
"\u001B[K |████████████████████████████████| 14.1 MB 29 kB/s \n",
"\u001B[?25hCollecting Werkzeug==0.16.1\n",
" Downloading Werkzeug-0.16.1-py2.py3-none-any.whl (327 kB)\n",
"\u001b[K |████████████████████████████████| 327 kB 56.0 MB/s \n",
"\u001b[?25hCollecting torch<1.9,>1.5\n",
"\u001B[K |████████████████████████████████| 327 kB 56.0 MB/s \n",
"\u001B[?25hCollecting torch<1.9,>1.5\n",
" Downloading torch-1.8.1-cp37-cp37m-manylinux1_x86_64.whl (804.1 MB)\n",
"\u001b[K |████████████████████████████████| 804.1 MB 2.8 kB/s \n",
"\u001b[?25hRequirement already satisfied: msgpack<2.0.0,>=1.0.0 in /usr/local/lib/python3.7/dist-packages (from ray==1.5.0->farm-haystack==0.9.0) (1.0.2)\n",
"\u001B[K |████████████████████████████████| 804.1 MB 2.8 kB/s \n",
"\u001B[?25hRequirement already satisfied: msgpack<2.0.0,>=1.0.0 in /usr/local/lib/python3.7/dist-packages (from ray==1.5.0->farm-haystack==0.9.0) (1.0.2)\n",
"Requirement already satisfied: click>=7.0 in /usr/local/lib/python3.7/dist-packages (from ray==1.5.0->farm-haystack==0.9.0) (7.1.2)\n",
"Requirement already satisfied: protobuf>=3.15.3 in /usr/local/lib/python3.7/dist-packages (from ray==1.5.0->farm-haystack==0.9.0) (3.17.3)\n",
"Collecting opencensus\n",
" Downloading opencensus-0.7.13-py2.py3-none-any.whl (127 kB)\n",
"\u001b[K |████████████████████████████████| 127 kB 73.2 MB/s \n",
"\u001b[?25hRequirement already satisfied: jsonschema in /usr/local/lib/python3.7/dist-packages (from ray==1.5.0->farm-haystack==0.9.0) (2.6.0)\n",
"\u001B[K |████████████████████████████████| 127 kB 73.2 MB/s \n",
"\u001B[?25hRequirement already satisfied: jsonschema in /usr/local/lib/python3.7/dist-packages (from ray==1.5.0->farm-haystack==0.9.0) (2.6.0)\n",
"Collecting pydantic>=1.8\n",
" Downloading pydantic-1.8.2-cp37-cp37m-manylinux2014_x86_64.whl (10.1 MB)\n",
"\u001b[K |████████████████████████████████| 10.1 MB 55.7 MB/s \n",
"\u001b[?25hCollecting aioredis\n",
"\u001B[K |████████████████████████████████| 10.1 MB 55.7 MB/s \n",
"\u001B[?25hCollecting aioredis\n",
" Downloading aioredis-2.0.0-py3-none-any.whl (69 kB)\n",
"\u001b[K |████████████████████████████████| 69 kB 9.2 MB/s \n",
"\u001b[?25hCollecting aiohttp-cors\n",
"\u001B[K |████████████████████████████████| 69 kB 9.2 MB/s \n",
"\u001B[?25hCollecting aiohttp-cors\n",
" Downloading aiohttp_cors-0.7.0-py3-none-any.whl (27 kB)\n",
"Collecting py-spy>=0.2.0\n",
" Downloading py_spy-0.3.8-py2.py3-none-manylinux_2_5_x86_64.manylinux1_x86_64.whl (3.1 MB)\n",
"\u001b[K |████████████████████████████████| 3.1 MB 52.9 MB/s \n",
"\u001b[?25hRequirement already satisfied: grpcio>=1.28.1 in /usr/local/lib/python3.7/dist-packages (from ray==1.5.0->farm-haystack==0.9.0) (1.34.1)\n",
"\u001B[K |████████████████████████████████| 3.1 MB 52.9 MB/s \n",
"\u001B[?25hRequirement already satisfied: grpcio>=1.28.1 in /usr/local/lib/python3.7/dist-packages (from ray==1.5.0->farm-haystack==0.9.0) (1.34.1)\n",
"Requirement already satisfied: numpy>=1.16 in /usr/local/lib/python3.7/dist-packages (from ray==1.5.0->farm-haystack==0.9.0) (1.19.5)\n",
"Requirement already satisfied: filelock in /usr/local/lib/python3.7/dist-packages (from ray==1.5.0->farm-haystack==0.9.0) (3.0.12)\n",
"Requirement already satisfied: prometheus-client>=0.7.1 in /usr/local/lib/python3.7/dist-packages (from ray==1.5.0->farm-haystack==0.9.0) (0.11.0)\n",
"Requirement already satisfied: pyyaml in /usr/local/lib/python3.7/dist-packages (from ray==1.5.0->farm-haystack==0.9.0) (3.13)\n",
"Collecting gpustat\n",
" Downloading gpustat-0.6.0.tar.gz (78 kB)\n",
"\u001b[K |████████████████████████████████| 78 kB 8.6 MB/s \n",
"\u001b[?25hCollecting redis>=3.5.0\n",
"\u001B[K |████████████████████████████████| 78 kB 8.6 MB/s \n",
"\u001B[?25hCollecting redis>=3.5.0\n",
" Downloading redis-3.5.3-py2.py3-none-any.whl (72 kB)\n",
"\u001b[K |████████████████████████████████| 72 kB 641 kB/s \n",
"\u001b[?25hCollecting aiohttp\n",
"\u001B[K |████████████████████████████████| 72 kB 641 kB/s \n",
"\u001B[?25hCollecting aiohttp\n",
" Downloading aiohttp-3.7.4.post0-cp37-cp37m-manylinux2014_x86_64.whl (1.3 MB)\n",
"\u001b[K |████████████████████████████████| 1.3 MB 52.6 MB/s \n",
"\u001b[?25hCollecting colorama\n",
"\u001B[K |████████████████████████████████| 1.3 MB 52.6 MB/s \n",
"\u001B[?25hCollecting colorama\n",
" Downloading colorama-0.4.4-py2.py3-none-any.whl (16 kB)\n",
"Collecting huggingface-hub==0.0.8\n",
" Downloading huggingface_hub-0.0.8-py3-none-any.whl (34 kB)\n",
@ -248,107 +248,107 @@
"Requirement already satisfied: importlib-metadata in /usr/local/lib/python3.7/dist-packages (from transformers==4.6.1->farm==0.8.0->farm-haystack==0.9.0) (4.6.1)\n",
"Collecting tokenizers<0.11,>=0.10.1\n",
" Downloading tokenizers-0.10.3-cp37-cp37m-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_12_x86_64.manylinux2010_x86_64.whl (3.3 MB)\n",
"\u001b[K |████████████████████████████████| 3.3 MB 50.7 MB/s \n",
"\u001b[?25hRequirement already satisfied: packaging in /usr/local/lib/python3.7/dist-packages (from transformers==4.6.1->farm==0.8.0->farm-haystack==0.9.0) (21.0)\n",
"\u001B[K |████████████████████████████████| 3.3 MB 50.7 MB/s \n",
"\u001B[?25hRequirement already satisfied: packaging in /usr/local/lib/python3.7/dist-packages (from transformers==4.6.1->farm==0.8.0->farm-haystack==0.9.0) (21.0)\n",
"Collecting sacremoses\n",
" Downloading sacremoses-0.0.45-py3-none-any.whl (895 kB)\n",
"\u001b[K |████████████████████████████████| 895 kB 75.7 MB/s \n",
"\u001b[?25hCollecting validators>=0.18.2\n",
"\u001B[K |████████████████████████████████| 895 kB 75.7 MB/s \n",
"\u001B[?25hCollecting validators>=0.18.2\n",
" Downloading validators-0.18.2-py3-none-any.whl (19 kB)\n",
"Collecting tqdm\n",
" Downloading tqdm-4.62.0-py2.py3-none-any.whl (76 kB)\n",
"\u001b[K |████████████████████████████████| 76 kB 4.9 MB/s \n",
"\u001b[?25hRequirement already satisfied: urllib3<2,>=1.21.1 in /usr/local/lib/python3.7/dist-packages (from elasticsearch<=7.10,>=7.7->farm-haystack==0.9.0) (1.24.3)\n",
"\u001B[K |████████████████████████████████| 76 kB 4.9 MB/s \n",
"\u001B[?25hRequirement already satisfied: urllib3<2,>=1.21.1 in /usr/local/lib/python3.7/dist-packages (from elasticsearch<=7.10,>=7.7->farm-haystack==0.9.0) (1.24.3)\n",
"Requirement already satisfied: certifi in /usr/local/lib/python3.7/dist-packages (from elasticsearch<=7.10,>=7.7->farm-haystack==0.9.0) (2021.5.30)\n",
"Requirement already satisfied: six>=1.5.2 in /usr/local/lib/python3.7/dist-packages (from grpcio>=1.28.1->ray==1.5.0->farm-haystack==0.9.0) (1.15.0)\n",
"Requirement already satisfied: cloudpickle in /usr/local/lib/python3.7/dist-packages (from mlflow<=1.13.1->farm==0.8.0->farm-haystack==0.9.0) (1.3.0)\n",
"Collecting alembic<=1.4.1\n",
" Downloading alembic-1.4.1.tar.gz (1.1 MB)\n",
"\u001b[K |████████████████████████████████| 1.1 MB 61.2 MB/s \n",
"\u001b[?25hCollecting docker>=4.0.0\n",
"\u001B[K |████████████████████████████████| 1.1 MB 61.2 MB/s \n",
"\u001B[?25hCollecting docker>=4.0.0\n",
" Downloading docker-5.0.0-py2.py3-none-any.whl (146 kB)\n",
"\u001b[K |████████████████████████████████| 146 kB 61.4 MB/s \n",
"\u001b[?25hCollecting databricks-cli>=0.8.7\n",
"\u001B[K |████████████████████████████████| 146 kB 61.4 MB/s \n",
"\u001B[?25hCollecting databricks-cli>=0.8.7\n",
" Downloading databricks-cli-0.14.3.tar.gz (54 kB)\n",
"\u001b[K |████████████████████████████████| 54 kB 3.7 MB/s \n",
"\u001b[?25hRequirement already satisfied: entrypoints in /usr/local/lib/python3.7/dist-packages (from mlflow<=1.13.1->farm==0.8.0->farm-haystack==0.9.0) (0.3)\n",
"\u001B[K |████████████████████████████████| 54 kB 3.7 MB/s \n",
"\u001B[?25hRequirement already satisfied: entrypoints in /usr/local/lib/python3.7/dist-packages (from mlflow<=1.13.1->farm==0.8.0->farm-haystack==0.9.0) (0.3)\n",
"Collecting querystring-parser\n",
" Downloading querystring_parser-1.2.4-py2.py3-none-any.whl (7.9 kB)\n",
"Collecting azure-storage-blob>=12.0.0\n",
" Downloading azure_storage_blob-12.8.1-py2.py3-none-any.whl (345 kB)\n",
"\u001b[K |████████████████████████████████| 345 kB 63.3 MB/s \n",
"\u001b[?25hCollecting gitpython>=2.1.0\n",
"\u001B[K |████████████████████████████████| 345 kB 63.3 MB/s \n",
"\u001B[?25hCollecting gitpython>=2.1.0\n",
" Downloading GitPython-3.1.18-py3-none-any.whl (170 kB)\n",
"\u001b[K |████████████████████████████████| 170 kB 77.2 MB/s \n",
"\u001b[?25hCollecting prometheus-flask-exporter\n",
"\u001B[K |████████████████████████████████| 170 kB 77.2 MB/s \n",
"\u001B[?25hCollecting prometheus-flask-exporter\n",
" Downloading prometheus_flask_exporter-0.18.2.tar.gz (22 kB)\n",
"Requirement already satisfied: python-dateutil in /usr/local/lib/python3.7/dist-packages (from mlflow<=1.13.1->farm==0.8.0->farm-haystack==0.9.0) (2.8.1)\n",
"Requirement already satisfied: sqlparse>=0.3.1 in /usr/local/lib/python3.7/dist-packages (from mlflow<=1.13.1->farm==0.8.0->farm-haystack==0.9.0) (0.4.1)\n",
"Collecting Mako\n",
" Downloading Mako-1.1.4-py2.py3-none-any.whl (75 kB)\n",
"\u001b[K |████████████████████████████████| 75 kB 5.5 MB/s \n",
"\u001b[?25hCollecting python-editor>=0.3\n",
"\u001B[K |████████████████████████████████| 75 kB 5.5 MB/s \n",
"\u001B[?25hCollecting python-editor>=0.3\n",
" Downloading python_editor-1.0.4-py3-none-any.whl (4.9 kB)\n",
"Collecting cryptography>=2.1.4\n",
" Downloading cryptography-3.4.7-cp36-abi3-manylinux2014_x86_64.whl (3.2 MB)\n",
"\u001b[K |████████████████████████████████| 3.2 MB 51.8 MB/s \n",
"\u001b[?25hCollecting msrest>=0.6.18\n",
"\u001B[K |████████████████████████████████| 3.2 MB 51.8 MB/s \n",
"\u001B[?25hCollecting msrest>=0.6.18\n",
" Downloading msrest-0.6.21-py2.py3-none-any.whl (85 kB)\n",
"\u001b[K |████████████████████████████████| 85 kB 4.9 MB/s \n",
"\u001b[?25hCollecting azure-core<2.0.0,>=1.10.0\n",
"\u001B[K |████████████████████████████████| 85 kB 4.9 MB/s \n",
"\u001B[?25hCollecting azure-core<2.0.0,>=1.10.0\n",
" Downloading azure_core-1.17.0-py2.py3-none-any.whl (165 kB)\n",
"\u001b[K |████████████████████████████████| 165 kB 66.2 MB/s \n",
"\u001b[?25hRequirement already satisfied: cffi>=1.12 in /usr/local/lib/python3.7/dist-packages (from cryptography>=2.1.4->azure-storage-blob>=12.0.0->mlflow<=1.13.1->farm==0.8.0->farm-haystack==0.9.0) (1.14.6)\n",
"\u001B[K |████████████████████████████████| 165 kB 66.2 MB/s \n",
"\u001B[?25hRequirement already satisfied: cffi>=1.12 in /usr/local/lib/python3.7/dist-packages (from cryptography>=2.1.4->azure-storage-blob>=12.0.0->mlflow<=1.13.1->farm==0.8.0->farm-haystack==0.9.0) (1.14.6)\n",
"Requirement already satisfied: pycparser in /usr/local/lib/python3.7/dist-packages (from cffi>=1.12->cryptography>=2.1.4->azure-storage-blob>=12.0.0->mlflow<=1.13.1->farm==0.8.0->farm-haystack==0.9.0) (2.20)\n",
"Requirement already satisfied: tabulate>=0.7.7 in /usr/local/lib/python3.7/dist-packages (from databricks-cli>=0.8.7->mlflow<=1.13.1->farm==0.8.0->farm-haystack==0.9.0) (0.8.9)\n",
"Collecting websocket-client>=0.32.0\n",
" Downloading websocket_client-1.1.1-py2.py3-none-any.whl (68 kB)\n",
"\u001b[K |████████████████████████████████| 68 kB 8.0 MB/s \n",
"\u001b[?25hCollecting gitdb<5,>=4.0.1\n",
"\u001B[K |████████████████████████████████| 68 kB 8.0 MB/s \n",
"\u001B[?25hCollecting gitdb<5,>=4.0.1\n",
" Downloading gitdb-4.0.7-py3-none-any.whl (63 kB)\n",
"\u001b[K |████████████████████████████████| 63 kB 2.0 MB/s \n",
"\u001b[?25hRequirement already satisfied: typing-extensions>=3.7.4.0 in /usr/local/lib/python3.7/dist-packages (from gitpython>=2.1.0->mlflow<=1.13.1->farm==0.8.0->farm-haystack==0.9.0) (3.7.4.3)\n",
"\u001B[K |████████████████████████████████| 63 kB 2.0 MB/s \n",
"\u001B[?25hRequirement already satisfied: typing-extensions>=3.7.4.0 in /usr/local/lib/python3.7/dist-packages (from gitpython>=2.1.0->mlflow<=1.13.1->farm==0.8.0->farm-haystack==0.9.0) (3.7.4.3)\n",
"Collecting smmap<5,>=3.0.1\n",
" Downloading smmap-4.0.0-py2.py3-none-any.whl (24 kB)\n",
"Requirement already satisfied: requests-oauthlib>=0.5.0 in /usr/local/lib/python3.7/dist-packages (from msrest>=0.6.18->azure-storage-blob>=12.0.0->mlflow<=1.13.1->farm==0.8.0->farm-haystack==0.9.0) (1.3.0)\n",
"Collecting isodate>=0.6.0\n",
" Downloading isodate-0.6.0-py2.py3-none-any.whl (45 kB)\n",
"\u001b[K |████████████████████████████████| 45 kB 4.2 MB/s \n",
"\u001b[?25hRequirement already satisfied: chardet<4,>=3.0.2 in /usr/local/lib/python3.7/dist-packages (from requests->farm==0.8.0->farm-haystack==0.9.0) (3.0.4)\n",
"\u001B[K |████████████████████████████████| 45 kB 4.2 MB/s \n",
"\u001B[?25hRequirement already satisfied: chardet<4,>=3.0.2 in /usr/local/lib/python3.7/dist-packages (from requests->farm==0.8.0->farm-haystack==0.9.0) (3.0.4)\n",
"Requirement already satisfied: idna<3,>=2.5 in /usr/local/lib/python3.7/dist-packages (from requests->farm==0.8.0->farm-haystack==0.9.0) (2.10)\n",
"Requirement already satisfied: oauthlib>=3.0.0 in /usr/local/lib/python3.7/dist-packages (from requests-oauthlib>=0.5.0->msrest>=0.6.18->azure-storage-blob>=12.0.0->mlflow<=1.13.1->farm==0.8.0->farm-haystack==0.9.0) (3.1.1)\n",
"Requirement already satisfied: greenlet!=0.4.17 in /usr/local/lib/python3.7/dist-packages (from sqlalchemy>=1.4.2->farm-haystack==0.9.0) (1.1.0)\n",
"Requirement already satisfied: decorator>=3.4.0 in /usr/local/lib/python3.7/dist-packages (from validators>=0.18.2->weaviate-client==2.5.0->farm-haystack==0.9.0) (4.4.2)\n",
"Collecting multidict<7.0,>=4.5\n",
" Downloading multidict-5.1.0-cp37-cp37m-manylinux2014_x86_64.whl (142 kB)\n",
"\u001b[K |████████████████████████████████| 142 kB 72.9 MB/s \n",
"\u001b[?25hCollecting yarl<2.0,>=1.0\n",
"\u001B[K |████████████████████████████████| 142 kB 72.9 MB/s \n",
"\u001B[?25hCollecting yarl<2.0,>=1.0\n",
" Downloading yarl-1.6.3-cp37-cp37m-manylinux2014_x86_64.whl (294 kB)\n",
"\u001b[K |████████████████████████████████| 294 kB 66.3 MB/s \n",
"\u001b[?25hCollecting async-timeout<4.0,>=3.0\n",
"\u001B[K |████████████████████████████████| 294 kB 66.3 MB/s \n",
"\u001B[?25hCollecting async-timeout<4.0,>=3.0\n",
" Downloading async_timeout-3.0.1-py3-none-any.whl (8.2 kB)\n",
"Requirement already satisfied: attrs>=17.3.0 in /usr/local/lib/python3.7/dist-packages (from aiohttp->ray==1.5.0->farm-haystack==0.9.0) (21.2.0)\n",
"Collecting botocore<1.22.0,>=1.21.15\n",
" Downloading botocore-1.21.15-py3-none-any.whl (7.8 MB)\n",
"\u001b[K |████████████████████████████████| 7.8 MB 70.3 MB/s \n",
"\u001b[?25hCollecting jmespath<1.0.0,>=0.7.1\n",
"\u001B[K |████████████████████████████████| 7.8 MB 70.3 MB/s \n",
"\u001B[?25hCollecting jmespath<1.0.0,>=0.7.1\n",
" Downloading jmespath-0.10.0-py2.py3-none-any.whl (24 kB)\n",
"Collecting s3transfer<0.6.0,>=0.5.0\n",
" Downloading s3transfer-0.5.0-py3-none-any.whl (79 kB)\n",
"\u001b[K |████████████████████████████████| 79 kB 9.9 MB/s \n",
"\u001b[?25hCollecting urllib3<2,>=1.21.1\n",
"\u001B[K |████████████████████████████████| 79 kB 9.9 MB/s \n",
"\u001B[?25hCollecting urllib3<2,>=1.21.1\n",
" Downloading urllib3-1.25.11-py2.py3-none-any.whl (127 kB)\n",
"\u001b[K |████████████████████████████████| 127 kB 71.3 MB/s \n",
"\u001b[?25hCollecting starlette==0.14.2\n",
"\u001B[K |████████████████████████████████| 127 kB 71.3 MB/s \n",
"\u001B[?25hCollecting starlette==0.14.2\n",
" Downloading starlette-0.14.2-py3-none-any.whl (60 kB)\n",
"\u001b[K |████████████████████████████████| 60 kB 9.2 MB/s \n",
"\u001b[?25hRequirement already satisfied: Jinja2<3.0,>=2.10.1 in /usr/local/lib/python3.7/dist-packages (from flask->farm==0.8.0->farm-haystack==0.9.0) (2.11.3)\n",
"\u001B[K |████████████████████████████████| 60 kB 9.2 MB/s \n",
"\u001B[?25hRequirement already satisfied: Jinja2<3.0,>=2.10.1 in /usr/local/lib/python3.7/dist-packages (from flask->farm==0.8.0->farm-haystack==0.9.0) (2.11.3)\n",
"Requirement already satisfied: itsdangerous<2.0,>=0.24 in /usr/local/lib/python3.7/dist-packages (from flask->farm==0.8.0->farm-haystack==0.9.0) (1.1.0)\n",
"Requirement already satisfied: MarkupSafe>=0.23 in /usr/local/lib/python3.7/dist-packages (from Jinja2<3.0,>=2.10.1->flask->farm==0.8.0->farm-haystack==0.9.0) (2.0.1)\n",
"Collecting aniso8601>=0.82\n",
" Downloading aniso8601-9.0.1-py2.py3-none-any.whl (52 kB)\n",
"\u001b[K |████████████████████████████████| 52 kB 1.6 MB/s \n",
"\u001b[?25hRequirement already satisfied: pytz in /usr/local/lib/python3.7/dist-packages (from flask-restplus->farm==0.8.0->farm-haystack==0.9.0) (2018.9)\n",
"\u001B[K |████████████████████████████████| 52 kB 1.6 MB/s \n",
"\u001B[?25hRequirement already satisfied: pytz in /usr/local/lib/python3.7/dist-packages (from flask-restplus->farm==0.8.0->farm-haystack==0.9.0) (2018.9)\n",
"Requirement already satisfied: nvidia-ml-py3>=7.352.0 in /usr/local/lib/python3.7/dist-packages (from gpustat->ray==1.5.0->farm-haystack==0.9.0) (7.352.0)\n",
"Collecting blessings>=1.6\n",
" Downloading blessings-1.7-py3-none-any.whl (18 kB)\n",
@ -366,24 +366,24 @@
"Requirement already satisfied: grpcio-tools<1.38.0,>=1.22.0 in /usr/local/lib/python3.7/dist-packages (from pymilvus->farm-haystack==0.9.0) (1.34.1)\n",
"Collecting ujson>=2.0.0\n",
" Downloading ujson-4.0.2-cp37-cp37m-manylinux1_x86_64.whl (179 kB)\n",
"\u001b[K |████████████████████████████████| 179 kB 71.9 MB/s \n",
"\u001b[?25hRequirement already satisfied: lxml>=2.3.2 in /usr/local/lib/python3.7/dist-packages (from python-docx->farm-haystack==0.9.0) (4.2.6)\n",
"\u001B[K |████████████████████████████████| 179 kB 71.9 MB/s \n",
"\u001B[?25hRequirement already satisfied: lxml>=2.3.2 in /usr/local/lib/python3.7/dist-packages (from python-docx->farm-haystack==0.9.0) (4.2.6)\n",
"Requirement already satisfied: joblib in /usr/local/lib/python3.7/dist-packages (from sacremoses->transformers==4.6.1->farm==0.8.0->farm-haystack==0.9.0) (1.0.1)\n",
"Requirement already satisfied: scikit-learn>=0.21.3 in /usr/local/lib/python3.7/dist-packages (from seqeval->farm==0.8.0->farm-haystack==0.9.0) (0.22.2.post1)\n",
"Collecting rdflib>=4.0\n",
" Downloading rdflib-6.0.0-py3-none-any.whl (376 kB)\n",
"\u001b[K |████████████████████████████████| 376 kB 65.9 MB/s \n",
"\u001b[?25hCollecting virtualenv!=20.0.0,!=20.0.1,!=20.0.2,!=20.0.3,!=20.0.4,!=20.0.5,!=20.0.6,!=20.0.7,>=16.0.0\n",
"\u001B[K |████████████████████████████████| 376 kB 65.9 MB/s \n",
"\u001B[?25hCollecting virtualenv!=20.0.0,!=20.0.1,!=20.0.2,!=20.0.3,!=20.0.4,!=20.0.5,!=20.0.6,!=20.0.7,>=16.0.0\n",
" Downloading virtualenv-20.7.0-py2.py3-none-any.whl (5.3 MB)\n",
"\u001b[K |████████████████████████████████| 5.3 MB 62.5 MB/s \n",
"\u001b[?25hCollecting pluggy>=0.12.0\n",
"\u001B[K |████████████████████████████████| 5.3 MB 62.5 MB/s \n",
"\u001B[?25hCollecting pluggy>=0.12.0\n",
" Downloading pluggy-0.13.1-py2.py3-none-any.whl (18 kB)\n",
"Requirement already satisfied: py>=1.4.17 in /usr/local/lib/python3.7/dist-packages (from tox->farm-haystack==0.9.0) (1.10.0)\n",
"Requirement already satisfied: toml>=0.9.4 in /usr/local/lib/python3.7/dist-packages (from tox->farm-haystack==0.9.0) (0.10.2)\n",
"Collecting distlib<1,>=0.3.1\n",
" Downloading distlib-0.3.2-py2.py3-none-any.whl (338 kB)\n",
"\u001b[K |████████████████████████████████| 338 kB 43.3 MB/s \n",
"\u001b[?25hCollecting platformdirs<3,>=2\n",
"\u001B[K |████████████████████████████████| 338 kB 43.3 MB/s \n",
"\u001B[?25hCollecting platformdirs<3,>=2\n",
" Downloading platformdirs-2.2.0-py3-none-any.whl (13 kB)\n",
"Collecting backports.entry-points-selectable>=1.0.4\n",
" Downloading backports.entry_points_selectable-1.1.0-py2.py3-none-any.whl (6.2 kB)\n",
@ -391,39 +391,39 @@
" Downloading asgiref-3.4.1-py3-none-any.whl (25 kB)\n",
"Collecting h11>=0.8\n",
" Downloading h11-0.12.0-py3-none-any.whl (54 kB)\n",
"\u001b[K |████████████████████████████████| 54 kB 4.3 MB/s \n",
"\u001b[?25hBuilding wheels for collected packages: farm-haystack, alembic, databricks-cli, boto3, gpustat, langdetect, prometheus-flask-exporter, python-docx, python-multipart, seqeval, tika\n",
" Building wheel for farm-haystack (setup.py) ... \u001b[?25l\u001b[?25hdone\n",
"\u001B[K |████████████████████████████████| 54 kB 4.3 MB/s \n",
"\u001B[?25hBuilding wheels for collected packages: farm-haystack, alembic, databricks-cli, boto3, gpustat, langdetect, prometheus-flask-exporter, python-docx, python-multipart, seqeval, tika\n",
" Building wheel for farm-haystack (setup.py) ... \u001B[?25l\u001B[?25hdone\n",
" Created wheel for farm-haystack: filename=farm_haystack-0.9.0-py3-none-any.whl size=196795 sha256=71e7c6a25cf2c6bac68d8f044e6dcdf56ea0d8de51f4c45e1a324b7309fc8707\n",
" Stored in directory: /tmp/pip-ephem-wheel-cache-2lct2wx8/wheels/a7/05/3b/9b33368d9af06a39f8e6af2e97fa2af876e893ade323cfc2c9\n",
" Building wheel for alembic (setup.py) ... \u001b[?25l\u001b[?25hdone\n",
" Building wheel for alembic (setup.py) ... \u001B[?25l\u001B[?25hdone\n",
" Created wheel for alembic: filename=alembic-1.4.1-py2.py3-none-any.whl size=158170 sha256=bfb84593454b9461e33c68291954a0e6fdc6b1740b533f4eef16ca7e92b477d4\n",
" Stored in directory: /root/.cache/pip/wheels/be/5d/0a/9e13f53f4f5dfb67cd8d245bb7cdffe12f135846f491a283e3\n",
" Building wheel for databricks-cli (setup.py) ... \u001b[?25l\u001b[?25hdone\n",
" Building wheel for databricks-cli (setup.py) ... \u001B[?25l\u001B[?25hdone\n",
" Created wheel for databricks-cli: filename=databricks_cli-0.14.3-py3-none-any.whl size=100557 sha256=e6daae14b7a753191636c7d73921bdaaed002c20a748fa95f7d0d5bd2e44b844\n",
" Stored in directory: /root/.cache/pip/wheels/3b/60/14/6930445b08959fbdf4e3029bac7e1f2cccb2e94df8afa00b29\n",
" Building wheel for boto3 (setup.py) ... \u001b[?25l\u001b[?25hdone\n",
" Building wheel for boto3 (setup.py) ... \u001B[?25l\u001B[?25hdone\n",
" Created wheel for boto3: filename=boto3-1.18.15-py3-none-any.whl size=129022 sha256=941da18e031a9d097d33bc5de515f375f3355ec687ffeac8a4fea628fa85d472\n",
" Stored in directory: /root/.cache/pip/wheels/55/a5/fc/51fb60d7e4936acba6cac7e578e2b5ee050d6f5d8887e8af26\n",
" Building wheel for gpustat (setup.py) ... \u001b[?25l\u001b[?25hdone\n",
" Building wheel for gpustat (setup.py) ... \u001B[?25l\u001B[?25hdone\n",
" Created wheel for gpustat: filename=gpustat-0.6.0-py3-none-any.whl size=12617 sha256=75379773569a479ff41e1387e3d899ddf08ba5ffe7c4da9b6eeb7cac07ad4203\n",
" Stored in directory: /root/.cache/pip/wheels/e6/67/af/f1ad15974b8fd95f59a63dbf854483ebe5c7a46a93930798b8\n",
" Building wheel for langdetect (setup.py) ... \u001b[?25l\u001b[?25hdone\n",
" Building wheel for langdetect (setup.py) ... \u001B[?25l\u001B[?25hdone\n",
" Created wheel for langdetect: filename=langdetect-1.0.9-py3-none-any.whl size=993241 sha256=d4903cc8743695c4e32c288b805030f31497400d52795b25de26d7e389e215a5\n",
" Stored in directory: /root/.cache/pip/wheels/c5/96/8a/f90c59ed25d75e50a8c10a1b1c2d4c402e4dacfa87f3aff36a\n",
" Building wheel for prometheus-flask-exporter (setup.py) ... \u001b[?25l\u001b[?25hdone\n",
" Building wheel for prometheus-flask-exporter (setup.py) ... \u001B[?25l\u001B[?25hdone\n",
" Created wheel for prometheus-flask-exporter: filename=prometheus_flask_exporter-0.18.2-py3-none-any.whl size=17416 sha256=c101c93041961681d469994164d7bd43d318802d0317955277b26564976de7b3\n",
" Stored in directory: /root/.cache/pip/wheels/6a/1e/1c/c765920cb92b2f0343d2dd8b481a407cee2823f9b4bbd2e52a\n",
" Building wheel for python-docx (setup.py) ... \u001b[?25l\u001b[?25hdone\n",
" Building wheel for python-docx (setup.py) ... \u001B[?25l\u001B[?25hdone\n",
" Created wheel for python-docx: filename=python_docx-0.8.11-py3-none-any.whl size=184507 sha256=cccbf1f4c226287fe81fe4d58f8e65c68d3ab884d4fab837f4b0051cc8c0b0af\n",
" Stored in directory: /root/.cache/pip/wheels/f6/6f/b9/d798122a8b55b74ad30b5f52b01482169b445fbb84a11797a6\n",
" Building wheel for python-multipart (setup.py) ... \u001b[?25l\u001b[?25hdone\n",
" Building wheel for python-multipart (setup.py) ... \u001B[?25l\u001B[?25hdone\n",
" Created wheel for python-multipart: filename=python_multipart-0.0.5-py3-none-any.whl size=31679 sha256=620e5395c8fff57ce4eaf6f2d26cd6ef54f3dfafa794161ff87f6c0e8708a8da\n",
" Stored in directory: /root/.cache/pip/wheels/2c/41/7c/bfd1c180534ffdcc0972f78c5758f89881602175d48a8bcd2c\n",
" Building wheel for seqeval (setup.py) ... \u001b[?25l\u001b[?25hdone\n",
" Building wheel for seqeval (setup.py) ... \u001B[?25l\u001B[?25hdone\n",
" Created wheel for seqeval: filename=seqeval-1.2.2-py3-none-any.whl size=16181 sha256=c60ebc68c6d29430a85f1b973cc64c0305ed82adc6dcd641f4e580d1da0b770d\n",
" Stored in directory: /root/.cache/pip/wheels/05/96/ee/7cac4e74f3b19e3158dce26a20a1c86b3533c43ec72a549fd7\n",
" Building wheel for tika (setup.py) ... \u001b[?25l\u001b[?25hdone\n",
" Building wheel for tika (setup.py) ... \u001B[?25l\u001B[?25hdone\n",
" Created wheel for tika: filename=tika-1.24-py3-none-any.whl size=32893 sha256=b34e6394b653d1b60f1f96d8a68f259a107723834d7a0eeb64514bb1b46f9e1b\n",
" Stored in directory: /root/.cache/pip/wheels/ec/2b/38/58ff05467a742e32f67f5d0de048fa046e764e2fbb25ac93f3\n",
"Successfully built farm-haystack alembic databricks-cli boto3 gpustat langdetect prometheus-flask-exporter python-docx python-multipart seqeval tika\n",
@ -448,11 +448,11 @@
" Found existing installation: pluggy 0.7.1\n",
" Uninstalling pluggy-0.7.1:\n",
" Successfully uninstalled pluggy-0.7.1\n",
"\u001b[31mERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts.\n",
"\u001B[31mERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts.\n",
"torchvision 0.10.0+cu102 requires torch==1.9.0, but you have torch 1.8.1 which is incompatible.\n",
"torchtext 0.10.0 requires torch==1.9.0, but you have torch 1.8.1 which is incompatible.\n",
"pytest 3.6.4 requires pluggy<0.8,>=0.5, but you have pluggy 0.13.1 which is incompatible.\n",
"datascience 0.10.6 requires folium==0.2.1, but you have folium 0.8.3 which is incompatible.\u001b[0m\n",
"datascience 0.10.6 requires folium==0.2.1, but you have folium 0.8.3 which is incompatible.\u001B[0m\n",
"Successfully installed Mako-1.1.4 SPARQLWrapper-1.8.5 Werkzeug-0.16.1 aiohttp-3.7.4.post0 aiohttp-cors-0.7.0 aioredis-2.0.0 alembic-1.4.1 aniso8601-9.0.1 asgiref-3.4.1 async-timeout-3.0.1 azure-core-1.17.0 azure-storage-blob-12.8.1 backports.entry-points-selectable-1.1.0 blessings-1.7 boto3-1.18.15 botocore-1.21.15 colorama-0.4.4 cryptography-3.4.7 databricks-cli-0.14.3 distlib-0.3.2 docker-5.0.0 dotmap-1.3.24 elastic-apm-6.3.3 elasticsearch-7.10.0 faiss-cpu-1.7.1.post2 farm-0.8.0 farm-haystack-0.9.0 fastapi-0.68.0 flask-cors-3.0.10 flask-restplus-0.13.0 gitdb-4.0.7 gitpython-3.1.18 gpustat-0.6.0 gunicorn-20.1.0 h11-0.12.0 httptools-0.2.0 huggingface-hub-0.0.8 isodate-0.6.0 jmespath-0.10.0 langdetect-1.0.9 mlflow-1.13.1 mmh3-3.0.0 msrest-0.6.21 multidict-5.1.0 opencensus-0.7.13 opencensus-context-0.1.2 platformdirs-2.2.0 pluggy-0.13.1 prometheus-flask-exporter-0.18.2 psycopg2-binary-2.9.1 py-spy-0.3.8 pydantic-1.8.2 pymilvus-1.1.2 python-docx-0.8.11 python-editor-1.0.4 python-multipart-0.0.5 querystring-parser-1.2.4 ray-1.5.0 rdflib-6.0.0 redis-3.5.3 s3transfer-0.5.0 sacremoses-0.0.45 sentencepiece-0.1.96 seqeval-1.2.2 smmap-4.0.0 sqlalchemy-utils-0.37.8 starlette-0.14.2 tika-1.24 tokenizers-0.10.3 torch-1.8.1 tox-3.24.1 tqdm-4.62.0 transformers-4.6.1 ujson-4.0.2 urllib3-1.25.11 uvicorn-0.14.0 uvloop-0.14.0 validators-0.18.2 virtualenv-20.7.0 weaviate-client-2.5.0 websocket-client-1.1.1 yarl-1.6.3\n",
"Reading package lists... Done\n",
"Building dependency tree \n",
@ -516,9 +516,9 @@
"\n",
"Collecting pygraphviz\n",
" Downloading pygraphviz-1.7.zip (118 kB)\n",
"\u001b[K |████████████████████████████████| 118 kB 9.6 MB/s \n",
"\u001b[?25hBuilding wheels for collected packages: pygraphviz\n",
" Building wheel for pygraphviz (setup.py) ... \u001b[?25l\u001b[?25hdone\n",
"\u001B[K |████████████████████████████████| 118 kB 9.6 MB/s \n",
"\u001B[?25hBuilding wheels for collected packages: pygraphviz\n",
" Building wheel for pygraphviz (setup.py) ... \u001B[?25l\u001B[?25hdone\n",
" Created wheel for pygraphviz: filename=pygraphviz-1.7-cp37-cp37m-linux_x86_64.whl size=165731 sha256=e956a5dbf87a503b3b4120e8f362c55c1bd0963020def309651ce28d993e5fce\n",
" Stored in directory: /root/.cache/pip/wheels/8c/bc/0c/ac35392b72556e75107ff610cb31b313e8471918a6d280e34c\n",
"Successfully built pygraphviz\n",
@ -539,6 +539,8 @@
"!apt install libgraphviz-dev\n",
"!pip install pygraphviz\n",
"\n",
"# If you run this notebook on Google Colab, you might need to\n",
"# restart the runtime after installing haystack.\n",
"\n",
"# In Colab / No Docker environments: Start Elasticsearch from source\n",
"! wget https://artifacts.elastic.co/downloads/elasticsearch/elasticsearch-7.9.2-linux-x86_64.tar.gz -q\n",
@ -1946,15 +1948,6 @@
"pygments_lexer": "ipython3",
"version": "3.7.6"
},
"pycharm": {
"stem_cell": {
"cell_type": "raw",
"metadata": {
"collapsed": false
},
"source": []
}
},
"widgets": {
"application/vnd.jupyter.widget-state+json": {
"00aaf9b5872940b8b055dbb27caccda6": {
@ -7920,4 +7913,4 @@
},
"nbformat": 4,
"nbformat_minor": 1
}
}

5
tutorials/Tutorial1_Basic_QA_Pipeline.ipynb
View File

@ -60,7 +60,10 @@
"\n",
"# Install the latest master of Haystack\n",
"!pip install grpcio-tools==1.34.1\n",
"!pip install git+https://github.com/deepset-ai/haystack.git\n"
"!pip install git+https://github.com/deepset-ai/haystack.git\n",
"\n",
"# If you run this notebook on Google Colab, you might need to\n",
"# restart the runtime after installing haystack."
]
},
{

14
tutorials/Tutorial2_Finetune_a_model_on_your_data.ipynb
View File

@ -56,7 +56,10 @@
"\n",
"# Install the latest master of Haystack\n",
"!pip install grpcio-tools==1.34.1\n",
"!pip install git+https://github.com/deepset-ai/haystack.git\n"
"!pip install git+https://github.com/deepset-ai/haystack.git\n",
"\n",
"# If you run this notebook on Google Colab, you might need to\n",
"# restart the runtime after installing haystack."
]
},
{
@ -209,15 +212,6 @@
"nbconvert_exporter": "python",
"pygments_lexer": "ipython3",
"version": "3.7.6"
},
"pycharm": {
"stem_cell": {
"cell_type": "raw",
"source": [],
"metadata": {
"collapsed": false
}
}
}
},
"nbformat": 4,

5
tutorials/Tutorial3_Basic_QA_Pipeline_without_Elasticsearch.ipynb
View File

@ -56,7 +56,10 @@
"\n",
"# Install the latest master of Haystack\n",
"!pip install grpcio-tools==1.34.1\n",
"!pip install git+https://github.com/deepset-ai/haystack.git\n"
"!pip install git+https://github.com/deepset-ai/haystack.git\n",
"\n",
"# If you run this notebook on Google Colab, you might need to\n",
"# restart the runtime after installing haystack."
]
},
{

5
tutorials/Tutorial4_FAQ_style_QA.ipynb
View File

@ -64,7 +64,10 @@
"\n",
"# Install the latest master of Haystack\n",
"!pip install grpcio-tools==1.34.1\n",
"!pip install git+https://github.com/deepset-ai/haystack.git\n"
"!pip install git+https://github.com/deepset-ai/haystack.git\n",
"\n",
"# If you run this notebook on Google Colab, you might need to\n",
"# restart the runtime after installing haystack."
]
},
{

5
tutorials/Tutorial5_Evaluation.ipynb
View File

@ -77,7 +77,10 @@
"\n",
"# Install the latest master of Haystack\n",
"!pip install grpcio-tools==1.34.1\n",
"!pip install git+https://github.com/deepset-ai/haystack.git\n"
"!pip install git+https://github.com/deepset-ai/haystack.git\n",
"\n",
"# If you run this notebook on Google Colab, you might need to\n",
"# restart the runtime after installing haystack."
]
},
{

5
tutorials/Tutorial6_Better_Retrieval_via_DPR.ipynb
View File

@ -286,7 +286,10 @@
"\n",
"# Install the latest master of Haystack\n",
"!pip install grpcio-tools==1.34.1\n",
"!pip install git+https://github.com/deepset-ai/haystack.git\n"
"!pip install git+https://github.com/deepset-ai/haystack.git\n",
"\n",
"# If you run this notebook on Google Colab, you might need to\n",
"# restart the runtime after installing haystack."
]
},
{

7
tutorials/Tutorial7_RAG_Generator.ipynb
View File

@ -62,7 +62,10 @@
"outputs": [],
"source": [
"!pip install grpcio-tools==1.34.1\n",
"!pip install git+https://github.com/deepset-ai/haystack.git\n"
"!pip install git+https://github.com/deepset-ai/haystack.git\n",
"\n",
"# If you run this notebook on Google Colab, you might need to\n",
"# restart the runtime after installing haystack."
],
"metadata": {
"collapsed": false,
@ -388,4 +391,4 @@
},
"nbformat": 4,
"nbformat_minor": 0
}
}

14
tutorials/Tutorial8_Preprocessing.ipynb
View File

@ -61,7 +61,10 @@
"!pip install grpcio-tools==1.34.1\n",
"!pip install git+https://github.com/deepset-ai/haystack.git\n",
"!wget --no-check-certificate https://dl.xpdfreader.com/xpdf-tools-linux-4.03.tar.gz\n",
"!tar -xvf xpdf-tools-linux-4.03.tar.gz && sudo cp xpdf-tools-linux-4.03/bin64/pdftotext /usr/local/bin"
"!tar -xvf xpdf-tools-linux-4.03.tar.gz && sudo cp xpdf-tools-linux-4.03/bin64/pdftotext /usr/local/bin\n",
"\n",
"# If you run this notebook on Google Colab, you might need to\n",
"# restart the runtime after installing haystack."
],
"metadata": {
"collapsed": false,
@ -511,15 +514,6 @@
"nbconvert_exporter": "python",
"pygments_lexer": "ipython2",
"version": "2.7.6"
},
"pycharm": {
"stem_cell": {
"cell_type": "raw",
"source": [],
"metadata": {
"collapsed": false
}
}
}
},
"nbformat": 4,

14
tutorials/Tutorial9_DPR_training.ipynb
View File

@ -27,7 +27,10 @@
"\n",
"# Install the latest master of Haystack\n",
"!pip install grpcio-tools==1.34.1\n",
"!pip install git+https://github.com/deepset-ai/haystack.git"
"!pip install git+https://github.com/deepset-ai/haystack.git\n",
"\n",
"# If you run this notebook on Google Colab, you might need to\n",
"# restart the runtime after installing haystack."
],
"metadata": {
"collapsed": false,
@ -439,15 +442,6 @@
"nbconvert_exporter": "python",
"pygments_lexer": "ipython2",
"version": "2.7.6"
},
"pycharm": {
"stem_cell": {
"cell_type": "raw",
"source": [],
"metadata": {
"collapsed": false
}
}
}
},
"nbformat": 4,