mirror of
https://github.com/deepset-ai/haystack.git
synced 2025-07-23 08:52:16 +00:00
3c81103db7
* move logging config from haystack lib to application * Update Documentation & Code Style * config logging before importing haystack * Update Documentation & Code Style * add logging config to all tutorials * Update Documentation & Code Style Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
3450 lines
252 KiB
Plaintext
3450 lines
252 KiB
Plaintext
{
|
||
"cells": [
|
||
{
|
||
"cell_type": "markdown",
|
||
"metadata": {
|
||
"id": "DeAkZwDhufYA"
|
||
},
|
||
"source": [
|
||
"# Open-Domain QA on Tables\n",
|
||
"[](https://colab.research.google.com/github/deepset-ai/haystack/blob/master/tutorials/Tutorial15_TableQA.ipynb)\n",
|
||
"\n",
|
||
"This tutorial shows you how to perform question-answering on tables using the `EmbeddingRetriever` or `BM25Retriever` as retriever node and the `TableReader` as reader node."
|
||
]
|
||
},
|
||
{
|
||
"cell_type": "markdown",
|
||
"metadata": {
|
||
"id": "vbR3bETlvi-3"
|
||
},
|
||
"source": [
|
||
"### Prepare environment\n",
|
||
"\n",
|
||
"#### Colab: Enable the GPU runtime\n",
|
||
"Make sure you enable the GPU runtime to experience decent speed in this tutorial.\n",
|
||
"**Runtime -> Change Runtime type -> Hardware accelerator -> GPU**\n",
|
||
"\n",
|
||
"<img src=\"https://raw.githubusercontent.com/deepset-ai/haystack/master/docs/img/colab_gpu_runtime.jpg\">"
|
||
]
|
||
},
|
||
{
|
||
"cell_type": "code",
|
||
"execution_count": null,
|
||
"metadata": {
|
||
"id": "HW66x0rfujyO"
|
||
},
|
||
"outputs": [],
|
||
"source": [
|
||
"# Make sure you have a GPU running\n",
|
||
"!nvidia-smi"
|
||
]
|
||
},
|
||
{
|
||
"cell_type": "markdown",
|
||
"source": [
|
||
"## Logging\n",
|
||
"\n",
|
||
"We configure how logging messages should be displayed and which log level should be used before importing Haystack.\n",
|
||
"Example log message:\n",
|
||
"INFO - haystack.utils.preprocessing - Converting data/tutorial1/218_Olenna_Tyrell.txt\n",
|
||
"Default log level in basicConfig is WARNING so the explicit parameter is not necessary but can be changed easily:"
|
||
],
|
||
"metadata": {
|
||
"collapsed": false,
|
||
"pycharm": {
|
||
"name": "#%% md\n"
|
||
}
|
||
}
|
||
},
|
||
{
|
||
"cell_type": "code",
|
||
"execution_count": null,
|
||
"outputs": [],
|
||
"source": [
|
||
"import logging\n",
|
||
"\n",
|
||
"logging.basicConfig(format=\"%(levelname)s - %(name)s - %(message)s\", level=logging.WARNING)\n",
|
||
"logging.getLogger(\"haystack\").setLevel(logging.INFO)"
|
||
],
|
||
"metadata": {
|
||
"collapsed": false,
|
||
"pycharm": {
|
||
"name": "#%%\n"
|
||
}
|
||
}
|
||
},
|
||
{
|
||
"cell_type": "code",
|
||
"execution_count": null,
|
||
"metadata": {
|
||
"id": "_ZXoyhOAvn7M"
|
||
},
|
||
"outputs": [],
|
||
"source": [
|
||
"# Install the latest release of Haystack in your own environment\n",
|
||
"#! pip install farm-haystack\n",
|
||
"\n",
|
||
"# Install the latest master of Haystack\n",
|
||
"!pip install --upgrade pip\n",
|
||
"!pip install git+https://github.com/deepset-ai/haystack.git#egg=farm-haystack[colab]\n",
|
||
"\n",
|
||
"# The TaPAs-based TableReader requires the torch-scatter library\n",
|
||
"import torch\n",
|
||
"\n",
|
||
"version = torch.__version__\n",
|
||
"!pip install torch-scatter -f https://data.pyg.org/whl/torch-{version}.html\n",
|
||
"\n",
|
||
"# Install pygraphviz for visualization of Pipelines\n",
|
||
"!apt install libgraphviz-dev\n",
|
||
"!pip install pygraphviz"
|
||
]
|
||
},
|
||
{
|
||
"cell_type": "markdown",
|
||
"metadata": {
|
||
"id": "K_XJhluXwF5_"
|
||
},
|
||
"source": [
|
||
"### Start an Elasticsearch server\n",
|
||
"You can start Elasticsearch on your local machine instance using Docker. If Docker is not readily available in your environment (e.g. in Colab notebooks), then you can manually download and execute Elasticsearch from source."
|
||
]
|
||
},
|
||
{
|
||
"cell_type": "code",
|
||
"execution_count": null,
|
||
"metadata": {
|
||
"id": "frDqgzK7v2i1"
|
||
},
|
||
"outputs": [],
|
||
"source": [
|
||
"# Recommended: Start Elasticsearch using Docker via the Haystack utility function\n",
|
||
"from haystack.utils import launch_es\n",
|
||
"\n",
|
||
"launch_es()"
|
||
]
|
||
},
|
||
{
|
||
"cell_type": "code",
|
||
"execution_count": null,
|
||
"metadata": {
|
||
"id": "S4PGj1A6wKWu"
|
||
},
|
||
"outputs": [],
|
||
"source": [
|
||
"# In Colab / No Docker environments: Start Elasticsearch from source\n",
|
||
"! wget https://artifacts.elastic.co/downloads/elasticsearch/elasticsearch-7.9.2-linux-x86_64.tar.gz -q\n",
|
||
"! tar -xzf elasticsearch-7.9.2-linux-x86_64.tar.gz\n",
|
||
"! chown -R daemon:daemon elasticsearch-7.9.2\n",
|
||
"\n",
|
||
"import os\n",
|
||
"from subprocess import Popen, PIPE, STDOUT\n",
|
||
"\n",
|
||
"es_server = Popen(\n",
|
||
" [\"elasticsearch-7.9.2/bin/elasticsearch\"], stdout=PIPE, stderr=STDOUT, preexec_fn=lambda: os.setuid(1) # as daemon\n",
|
||
")\n",
|
||
"# wait until ES has started\n",
|
||
"! sleep 30"
|
||
]
|
||
},
|
||
{
|
||
"cell_type": "code",
|
||
"execution_count": 3,
|
||
"metadata": {
|
||
"id": "RmxepXZtwQ0E"
|
||
},
|
||
"outputs": [],
|
||
"source": [
|
||
"# Connect to Elasticsearch\n",
|
||
"from haystack.document_stores import ElasticsearchDocumentStore\n",
|
||
"\n",
|
||
"document_index = \"document\"\n",
|
||
"document_store = ElasticsearchDocumentStore(host=\"localhost\", username=\"\", password=\"\", index=document_index)"
|
||
]
|
||
},
|
||
{
|
||
"cell_type": "markdown",
|
||
"metadata": {
|
||
"id": "fFh26LIlxldw"
|
||
},
|
||
"source": [
|
||
"## Add Tables to DocumentStore\n",
|
||
"To quickly demonstrate the capabilities of the `EmbeddingRetriever` and the `TableReader` we use a subset of 1000 tables and text documents from a dataset we have published in [this paper](https://arxiv.org/abs/2108.04049).\n",
|
||
"\n",
|
||
"Just as text passages, tables are represented as `Document` objects in Haystack. The content field, though, is a pandas DataFrame instead of a string."
|
||
]
|
||
},
|
||
{
|
||
"cell_type": "code",
|
||
"execution_count": null,
|
||
"metadata": {
|
||
"id": "nM63uwbd8zd6"
|
||
},
|
||
"outputs": [],
|
||
"source": [
|
||
"# Let's first fetch some tables that we want to query\n",
|
||
"# Here: 1000 tables from OTT-QA\n",
|
||
"from haystack.utils import fetch_archive_from_http\n",
|
||
"\n",
|
||
"doc_dir = \"data/tutorial15\"\n",
|
||
"s3_url = \"https://s3.eu-central-1.amazonaws.com/deepset.ai-farm-qa/datasets/documents/table_text_dataset.zip\"\n",
|
||
"fetch_archive_from_http(url=s3_url, output_dir=doc_dir)"
|
||
]
|
||
},
|
||
{
|
||
"cell_type": "code",
|
||
"execution_count": 5,
|
||
"metadata": {
|
||
"colab": {
|
||
"base_uri": "https://localhost:8080/"
|
||
},
|
||
"id": "SKjw2LuXxlGh",
|
||
"outputId": "92c67d24-d6fb-413e-8dd7-53075141d508"
|
||
},
|
||
"outputs": [
|
||
{
|
||
"name": "stdout",
|
||
"output_type": "stream",
|
||
"text": [
|
||
" Opponent M W L T NR Win% First Last\n",
|
||
"0 Afghanistan 2 2 0 0 0 100.0 2012 2014\n",
|
||
"1 Australia 98 32 62 1 3 34.21 1975 2017\n",
|
||
"2 Bangladesh 35 31 4 0 0 88.57 1986 2015\n",
|
||
"3 Canada 2 2 0 0 0 100.0 1979 2011\n",
|
||
"4 England 82 31 49 0 2 38.75 1974 2017\n",
|
||
"5 Hong Kong 2 2 0 0 0 100.0 2004 2008\n",
|
||
"6 India 129 73 52 0 4 58.4 1978 2017\n",
|
||
"7 Ireland 7 5 1 1 0 78.57 2007 2016\n",
|
||
"8 Kenya 6 6 0 0 0 100.0 1996 2011\n",
|
||
"9 Namibia 1 1 0 0 0 100.0 2003 2003\n",
|
||
"10 Netherlands 3 3 0 0 0 100.0 1996 2003\n",
|
||
"11 New Zealand 103 53 47 1 2 52.97 1973 2018\n",
|
||
"12 Scotland 3 3 0 0 0 100.0 1999 2013\n",
|
||
"13 South Africa 73 25 47 0 1 34.72 1992 2017\n",
|
||
"14 Sri Lanka 153 90 58 1 4 60.73 1975 2017\n",
|
||
"15 United Arab Emirates 3 3 0 0 0 100.0 1994 2015\n",
|
||
"16 West Indies 133 60 70 3 0 46.24 1975 2017\n",
|
||
"17 Zimbabwe 59 52 4 1 2 92.1 1992 2018\n",
|
||
"18 Total[12] 894 474 394 8 18 54.56 1973 2018\n",
|
||
"{}\n"
|
||
]
|
||
}
|
||
],
|
||
"source": [
|
||
"# Add the tables to the DocumentStore\n",
|
||
"\n",
|
||
"import json\n",
|
||
"from haystack import Document\n",
|
||
"import pandas as pd\n",
|
||
"\n",
|
||
"\n",
|
||
"def read_tables(filename):\n",
|
||
" processed_tables = []\n",
|
||
" with open(filename) as tables:\n",
|
||
" tables = json.load(tables)\n",
|
||
" for key, table in tables.items():\n",
|
||
" current_columns = table[\"header\"]\n",
|
||
" current_rows = table[\"data\"]\n",
|
||
" current_df = pd.DataFrame(columns=current_columns, data=current_rows)\n",
|
||
" document = Document(content=current_df, content_type=\"table\", id=key)\n",
|
||
" processed_tables.append(document)\n",
|
||
"\n",
|
||
" return processed_tables\n",
|
||
"\n",
|
||
"\n",
|
||
"tables = read_tables(f\"{doc_dir}/tables.json\")\n",
|
||
"document_store.write_documents(tables, index=document_index)\n",
|
||
"\n",
|
||
"# Showing content field and meta field of one of the Documents of content_type 'table'\n",
|
||
"print(tables[0].content)\n",
|
||
"print(tables[0].meta)"
|
||
]
|
||
},
|
||
{
|
||
"cell_type": "markdown",
|
||
"metadata": {
|
||
"id": "hmQC1sDmw3d7"
|
||
},
|
||
"source": [
|
||
"## Initialize Retriever, Reader & Pipeline\n",
|
||
"\n",
|
||
"### Retriever\n",
|
||
"\n",
|
||
"Retrievers help narrowing down the scope for the Reader to a subset of tables where a given question could be answered.\n",
|
||
"They use some simple but fast algorithm.\n",
|
||
"\n",
|
||
"**Here:** We specify an embedding model that is finetuned so it can also generate embeddings for tables (instead of just text).\n",
|
||
"\n",
|
||
"**Alternatives:**\n",
|
||
"\n",
|
||
"- `BM25Retriever` that uses BM25 algorithm\n"
|
||
]
|
||
},
|
||
{
|
||
"cell_type": "code",
|
||
"execution_count": null,
|
||
"metadata": {
|
||
"id": "EY_qvdV6wyK5"
|
||
},
|
||
"outputs": [],
|
||
"source": [
|
||
"from haystack.nodes.retriever import EmbeddingRetriever\n",
|
||
"\n",
|
||
"retriever = EmbeddingRetriever(document_store=document_store, embedding_model=\"deepset/all-mpnet-base-v2-table\")"
|
||
]
|
||
},
|
||
{
|
||
"cell_type": "code",
|
||
"execution_count": null,
|
||
"metadata": {
|
||
"id": "jasi1RM2zIJ7"
|
||
},
|
||
"outputs": [],
|
||
"source": [
|
||
"# Add table embeddings to the tables in DocumentStore\n",
|
||
"document_store.update_embeddings(retriever=retriever)"
|
||
]
|
||
},
|
||
{
|
||
"cell_type": "code",
|
||
"execution_count": null,
|
||
"metadata": {
|
||
"id": "XM-ijy6Zz11L"
|
||
},
|
||
"outputs": [],
|
||
"source": [
|
||
"## Alternative: BM25Retriever\n",
|
||
"# from haystack.nodes.retriever import BM25Retriever\n",
|
||
"# retriever = BM25Retriever(document_store=document_store)"
|
||
]
|
||
},
|
||
{
|
||
"cell_type": "code",
|
||
"execution_count": 8,
|
||
"metadata": {
|
||
"colab": {
|
||
"base_uri": "https://localhost:8080/"
|
||
},
|
||
"id": "YHfQWxVI0N2e",
|
||
"outputId": "1d8dc4d2-a184-489e-defa-d445d76c458f"
|
||
},
|
||
"outputs": [
|
||
{
|
||
"data": {
|
||
"application/vnd.jupyter.widget-view+json": {
|
||
"model_id": "c31185c0629c46769fb7e7e2eb016fa1",
|
||
"version_major": 2,
|
||
"version_minor": 0
|
||
},
|
||
"text/plain": [
|
||
"Batches: 0%| | 0/1 [00:00<?, ?it/s]"
|
||
]
|
||
},
|
||
"metadata": {},
|
||
"output_type": "display_data"
|
||
},
|
||
{
|
||
"name": "stdout",
|
||
"output_type": "stream",
|
||
"text": [
|
||
" Year Coach Super Bowl \\\n",
|
||
"0 1966 Vince Lombardi I \n",
|
||
"1 1967 Vince Lombardi II \n",
|
||
"2 1996 Mike Holmgren XXXI \n",
|
||
"3 2010 Mike McCarthy XLV \n",
|
||
"4 Total Super Bowls won: Total Super Bowls won: Total Super Bowls won: \n",
|
||
"\n",
|
||
" Location Opponent Score Record \n",
|
||
"0 Los Angeles, California Kansas City Chiefs 35–10 12–2 \n",
|
||
"1 Miami, Florida Oakland Raiders 33–14 9–4–1 \n",
|
||
"2 New Orleans, Louisiana New England Patriots 35–21 13–3 \n",
|
||
"3 Arlington, Texas Pittsburgh Steelers 31–25 10–6 \n",
|
||
"4 Total Super Bowls won: Total Super Bowls won: 4 4 \n"
|
||
]
|
||
}
|
||
],
|
||
"source": [
|
||
"# Try the Retriever\n",
|
||
"from haystack.utils import print_documents\n",
|
||
"\n",
|
||
"retrieved_tables = retriever.retrieve(\"Who won the Super Bowl?\", top_k=5)\n",
|
||
"# Get highest scored table\n",
|
||
"print(retrieved_tables[0].content)"
|
||
]
|
||
},
|
||
{
|
||
"cell_type": "markdown",
|
||
"metadata": {
|
||
"id": "zbwkXScm2-gy"
|
||
},
|
||
"source": [
|
||
"### Reader\n",
|
||
"The `TableReader` is based on TaPas, a transformer-based language model capable of grasping the two-dimensional structure of a table. It scans the tables returned by the retriever and extracts the anser. The available TableReader models can be found [here](https://huggingface.co/models?pipeline_tag=table-question-answering&sort=downloads).\n",
|
||
"\n",
|
||
"**Notice**: The `TableReader` will return an answer for each table, even if the query cannot be answered by the table. Furthermore, the confidence scores are not useful as of now, given that they will *always* be very high (i.e. 1 or close to 1)."
|
||
]
|
||
},
|
||
{
|
||
"cell_type": "code",
|
||
"execution_count": null,
|
||
"metadata": {
|
||
"id": "4APcRoio2RxG"
|
||
},
|
||
"outputs": [],
|
||
"source": [
|
||
"from haystack.nodes import TableReader\n",
|
||
"\n",
|
||
"reader = TableReader(model_name_or_path=\"google/tapas-base-finetuned-wtq\", max_seq_len=512)"
|
||
]
|
||
},
|
||
{
|
||
"cell_type": "code",
|
||
"execution_count": 10,
|
||
"metadata": {
|
||
"colab": {
|
||
"base_uri": "https://localhost:8080/"
|
||
},
|
||
"id": "ILuAXkyN4F7x",
|
||
"outputId": "4bd19dcb-df8e-4a4d-b9d2-d34650e9e5c2"
|
||
},
|
||
"outputs": [
|
||
{
|
||
"name": "stdout",
|
||
"output_type": "stream",
|
||
"text": [
|
||
" Name Program Role Salary Year \\\n",
|
||
"0 Simon Cowell The X Factor Judge $75 million 2012–13 \n",
|
||
"1 Britney Spears American Idol $25 million 2017–18 [15] \n",
|
||
"2 Jennifer Lopez $20 million 2011–12 [16] nan \n",
|
||
"3 Mariah Carey $18 million 2012–13 [17] nan \n",
|
||
"4 Hugh Laurie House Gregory House $15 million 2013 \n",
|
||
"5 Ryan Seacrest American Idol Host 2013–16 [14] \n",
|
||
"6 Katy Perry The X Factor Judge 2012 [17] \n",
|
||
"7 Miley Cyrus The Voice Coach $13 million 2016–17 \n",
|
||
"8 Adam Levine 2016–18 [18] nan nan \n",
|
||
"9 Blake Shelton 2016–18 [18] nan nan \n",
|
||
"10 Christina Aguilera $12.5 million 2013 [19] nan \n",
|
||
"11 Kelly Clarkson $12 million 2018 [20] nan \n",
|
||
"12 Shakira 2013 [19] nan nan \n",
|
||
"13 Gwen Stefani 2017 [21] nan nan \n",
|
||
"14 Nicki Minaj American Idol Judge 2012–13 [19] \n",
|
||
"\n",
|
||
" Ref. \n",
|
||
"0 [14] \n",
|
||
"1 nan \n",
|
||
"2 nan \n",
|
||
"3 nan \n",
|
||
"4 [14] \n",
|
||
"5 nan \n",
|
||
"6 nan \n",
|
||
"7 [18] \n",
|
||
"8 nan \n",
|
||
"9 nan \n",
|
||
"10 nan \n",
|
||
"11 nan \n",
|
||
"12 nan \n",
|
||
"13 nan \n",
|
||
"14 nan \n"
|
||
]
|
||
}
|
||
],
|
||
"source": [
|
||
"# Try the TableReader on one Table\n",
|
||
"\n",
|
||
"table_doc = document_store.get_document_by_id(\"36964e90-3735-4ba1-8e6a-bec236e88bb2\")\n",
|
||
"print(table_doc.content)"
|
||
]
|
||
},
|
||
{
|
||
"cell_type": "code",
|
||
"execution_count": 11,
|
||
"metadata": {
|
||
"colab": {
|
||
"base_uri": "https://localhost:8080/"
|
||
},
|
||
"id": "ilbsecgA4vfN",
|
||
"outputId": "f845f43e-43e8-48fe-d0ef-91b17a5eff0e"
|
||
},
|
||
"outputs": [
|
||
{
|
||
"name": "stdout",
|
||
"output_type": "stream",
|
||
"text": [
|
||
"\n",
|
||
"Query: Who played Gregory House in the series House?\n",
|
||
"Answers:\n",
|
||
"[ <Answer {'answer': 'Hugh Laurie', 'type': 'extractive', 'score': 1.0, 'context': Name Program Role Salary Year \\\n",
|
||
"0 Simon Cowell The X Factor Judge $75 million 2012–13 \n",
|
||
"1 Britney Spears American Idol $25 million 2017–18 [15] \n",
|
||
"2 Jennifer Lopez $20 million 2011–12 [16] nan \n",
|
||
"3 Mariah Carey $18 million 2012–13 [17] nan \n",
|
||
"4 Hugh Laurie House Gregory House $15 million 2013 \n",
|
||
"5 Ryan Seacrest American Idol Host 2013–16 [14] \n",
|
||
"6 Katy Perry The X Factor Judge 2012 [17] \n",
|
||
"7 Miley Cyrus The Voice Coach $13 million 2016–17 \n",
|
||
"8 Adam Levine 2016–18 [18] nan nan \n",
|
||
"9 Blake Shelton 2016–18 [18] nan nan \n",
|
||
"10 Christina Aguilera $12.5 million 2013 [19] nan \n",
|
||
"11 Kelly Clarkson $12 million 2018 [20] nan \n",
|
||
"12 Shakira 2013 [19] nan nan \n",
|
||
"13 Gwen Stefani 2017 [21] nan nan \n",
|
||
"14 Nicki Minaj American Idol Judge 2012–13 [19] \n",
|
||
"\n",
|
||
" Ref. \n",
|
||
"0 [14] \n",
|
||
"1 nan \n",
|
||
"2 nan \n",
|
||
"3 nan \n",
|
||
"4 [14] \n",
|
||
"5 nan \n",
|
||
"6 nan \n",
|
||
"7 [18] \n",
|
||
"8 nan \n",
|
||
"9 nan \n",
|
||
"10 nan \n",
|
||
"11 nan \n",
|
||
"12 nan \n",
|
||
"13 nan \n",
|
||
"14 nan , 'offsets_in_document': [{'start': 24, 'end': 25}], 'offsets_in_context': [{'start': 24, 'end': 25}], 'document_id': '36964e90-3735-4ba1-8e6a-bec236e88bb2', 'meta': {'aggregation_operator': 'NONE', 'answer_cells': ['Hugh Laurie']}}>]\n"
|
||
]
|
||
}
|
||
],
|
||
"source": [
|
||
"from haystack.utils import print_answers\n",
|
||
"\n",
|
||
"prediction = reader.predict(query=\"Who played Gregory House in the series House?\", documents=[table_doc])\n",
|
||
"print_answers(prediction, details=\"all\")"
|
||
]
|
||
},
|
||
{
|
||
"cell_type": "markdown",
|
||
"metadata": {
|
||
"id": "jkAYNMb7R9qu"
|
||
},
|
||
"source": [
|
||
"The offsets in the `offsets_in_document` and `offsets_in_context` field indicate the table cells that the model predicts to be part of the answer. They need to be interpreted on the linearized table, i.e., a flat list containing all of the table cells."
|
||
]
|
||
},
|
||
{
|
||
"cell_type": "code",
|
||
"execution_count": 12,
|
||
"metadata": {
|
||
"colab": {
|
||
"base_uri": "https://localhost:8080/"
|
||
},
|
||
"id": "It8XYT2ZTVJs",
|
||
"outputId": "7d31af60-e04a-485d-f0ee-f29592b03928"
|
||
},
|
||
"outputs": [
|
||
{
|
||
"name": "stdout",
|
||
"output_type": "stream",
|
||
"text": [
|
||
"Predicted answer: Hugh Laurie\n",
|
||
"Meta field: {'aggregation_operator': 'NONE', 'answer_cells': ['Hugh Laurie']}\n"
|
||
]
|
||
}
|
||
],
|
||
"source": [
|
||
"print(f\"Predicted answer: {prediction['answers'][0].answer}\")\n",
|
||
"print(f\"Meta field: {prediction['answers'][0].meta}\")"
|
||
]
|
||
},
|
||
{
|
||
"cell_type": "markdown",
|
||
"metadata": {
|
||
"id": "pgmG7pzL5ceh"
|
||
},
|
||
"source": [
|
||
"### Pipeline\n",
|
||
"The Retriever and the Reader can be sticked together to a pipeline in order to first retrieve relevant tables and then extract the answer.\n",
|
||
"\n",
|
||
"**Notice**: Given that the `TableReader` does not provide useful confidence scores and returns an answer for each of the tables, the sorting of the answers might be not helpful."
|
||
]
|
||
},
|
||
{
|
||
"cell_type": "code",
|
||
"execution_count": 13,
|
||
"metadata": {
|
||
"id": "G-aZZvyv4-Mf"
|
||
},
|
||
"outputs": [],
|
||
"source": [
|
||
"# Initialize pipeline\n",
|
||
"from haystack import Pipeline\n",
|
||
"\n",
|
||
"table_qa_pipeline = Pipeline()\n",
|
||
"table_qa_pipeline.add_node(component=retriever, name=\"EmbeddingRetriever\", inputs=[\"Query\"])\n",
|
||
"table_qa_pipeline.add_node(component=reader, name=\"TableReader\", inputs=[\"EmbeddingRetriever\"])"
|
||
]
|
||
},
|
||
{
|
||
"cell_type": "code",
|
||
"execution_count": 14,
|
||
"metadata": {
|
||
"colab": {
|
||
"base_uri": "https://localhost:8080/"
|
||
},
|
||
"id": "m8evexnW6dev",
|
||
"outputId": "40514084-f516-4f13-fb48-6a55cb578366"
|
||
},
|
||
"outputs": [
|
||
{
|
||
"data": {
|
||
"application/vnd.jupyter.widget-view+json": {
|
||
"model_id": "ce6722f406154bfebd4053040289b411",
|
||
"version_major": 2,
|
||
"version_minor": 0
|
||
},
|
||
"text/plain": [
|
||
"Batches: 0%| | 0/1 [00:00<?, ?it/s]"
|
||
]
|
||
},
|
||
"metadata": {},
|
||
"output_type": "display_data"
|
||
},
|
||
{
|
||
"name": "stderr",
|
||
"output_type": "stream",
|
||
"text": [
|
||
"/home/ubuntu/miniconda3/envs/pytorch/lib/python3.9/site-packages/numpy/core/fromnumeric.py:3440: RuntimeWarning: Mean of empty slice.\n",
|
||
" return _methods._mean(a, axis=axis, dtype=dtype,\n",
|
||
"/home/ubuntu/miniconda3/envs/pytorch/lib/python3.9/site-packages/numpy/core/_methods.py:189: RuntimeWarning: invalid value encountered in double_scalars\n",
|
||
" ret = ret.dtype.type(ret / rcount)\n"
|
||
]
|
||
},
|
||
{
|
||
"name": "stdout",
|
||
"output_type": "stream",
|
||
"text": [
|
||
"\n",
|
||
"Query: When was Guilty Gear Xrd : Sign released?\n",
|
||
"Answers:\n",
|
||
"[ { 'answer': 'December 16 , 2014',\n",
|
||
" 'context': Title First release \\\n",
|
||
"0 Guilty Gear Xrd : Sign December 16 , 2014 \n",
|
||
"1 BlazBlue : Chrono Phantasma Extend June 30 , 2015 \n",
|
||
"2 Aegis of Earth : Protonovus Assault March 15 , 2016 \n",
|
||
"3 BlazBlue : Central Fiction October 6 , 2016 \n",
|
||
"4 Chronicles of Teddy : Harmony of Exidus March 29 , 2016 \n",
|
||
"5 Guilty Gear Xrd : Revelator June 7 , 2016 \n",
|
||
"6 Exist Archive : The Other Side of the Sky October 18 , 2016 \n",
|
||
"7 Guilty Gear Xrd : Rev 2 May 25 , 2017 \n",
|
||
"8 Under Night In-Birth Exe : Late [ st ] Late 2017 \n",
|
||
"9 School Girl/Zombie Hunter Late 2017 \n",
|
||
"10 Tokyo Xanadu eX+ 2017 \n",
|
||
"11 Code : Realize ~Bouquet of Rainbows~ 2018 \n",
|
||
"12 Death Mark 2018 \n",
|
||
"13 NG ( Visual Novel ) 2019 \n",
|
||
"\n",
|
||
" Developer ( s ) Platform ( s ) \n",
|
||
"0 Arc System Works PlayStation 4 \n",
|
||
"1 Arc System Works PlayStation 4 \n",
|
||
"2 Acquire PlayStation 4 \n",
|
||
"3 Arc System Works PlayStation 4 \n",
|
||
"4 LookAtMyGame PlayStation 4 ( PSN ) \n",
|
||
"5 Arc System Works PlayStation 4 \n",
|
||
"6 Spike Chunsoft , tri-Ace PlayStation 4 \n",
|
||
"7 Arc System Works PlayStation 4 \n",
|
||
"8 Ecole Software , French Bread PlayStation 4 \n",
|
||
"9 Tamsoft PlayStation 4 \n",
|
||
"10 Falcom PlayStation 4 \n",
|
||
"11 Otomate PlayStation 4 \n",
|
||
"12 Experience Inc PlayStation 4 \n",
|
||
"13 Experience Inc PlayStation 4 },\n",
|
||
" { 'answer': 'October 7 , 2008',\n",
|
||
" 'context': Title \\\n",
|
||
"0 Battle Fantasia \n",
|
||
"1 Guilty Gear 2 : Overture \n",
|
||
"2 BlazBlue : Calamity Trigger \n",
|
||
"3 0-D Beat Drop \n",
|
||
"4 Record of Agarest War \n",
|
||
"5 DeathSmiles \n",
|
||
"6 BlazBlue : Continuum Shift \n",
|
||
"7 Record of Agarest War Zero \n",
|
||
"8 Bit.Trip Presents ... Runner2 : Future Legend of Rhythm Alien \n",
|
||
"9 A.R.E.S : Extinction Agenda EX \n",
|
||
"\n",
|
||
" First release Developer ( s ) Platform ( s ) \n",
|
||
"0 September 16 , 2008 Arc System Works Xbox 360 \n",
|
||
"1 October 7 , 2008 Arc System Works Xbox 360 \n",
|
||
"2 June 30 , 2009 Arc System Works Xbox 360 \n",
|
||
"3 November 11 , 2009 Cyclone Zero Xbox 360 ( XBLA ) \n",
|
||
"4 April 27 , 2010 Compile Heart , Red Entertainment Xbox 360 \n",
|
||
"5 June 28 , 2010 Cave Xbox 360 \n",
|
||
"6 July 27 , 2010 Arc System Works Xbox 360 \n",
|
||
"7 June 14 , 2011 Compile Heart , Red Entertainment Xbox 360 \n",
|
||
"8 February 27 , 2013 Gaijin Games Xbox 360 ( XBLA ) \n",
|
||
"9 October 2 , 2013 Extend Studio Xbox 360 ( XBLA ) },\n",
|
||
" { 'answer': 'April 7 , 2009',\n",
|
||
" 'context': Title First release \\\n",
|
||
"0 Guilty Gear XX Accent Core Plus April 7 , 2009 \n",
|
||
"1 BlazBlue : Calamity Trigger Portable February 25 , 2010 \n",
|
||
"2 Cho Aniki Zero March 25 , 2010 \n",
|
||
"3 Mimana Iyar Chronicle March 30 , 2010 \n",
|
||
"4 Gladiator Begins September 14 , 2010 \n",
|
||
"5 Blazing Souls Accelate October 19 , 2010 \n",
|
||
"6 Jikandia : The Timeless Land March 15 , 2011 \n",
|
||
"7 BlazBlue : Continuum Shift II May 31 , 2011 \n",
|
||
"8 Fate/Extra November 1 , 2011 \n",
|
||
"9 Hakuoki : Demon of the Fleeting Blossom February 14 , 2012 \n",
|
||
"10 Hakuoki : Warriors of the Shinsengumi November 6 , 2012 \n",
|
||
"11 Ragnarok Tactics February 19 , 2013 \n",
|
||
"12 Sweet Fuse : At Your Side August 27 , 2013 \n",
|
||
"\n",
|
||
" Developer ( s ) \\\n",
|
||
"0 Arc System Works \n",
|
||
"1 Arc System Works \n",
|
||
"2 extreme Co. , Ltd \n",
|
||
"3 Kogado Studio , Premium Agency \n",
|
||
"4 Goshow \n",
|
||
"5 Neverland \n",
|
||
"6 Opus Studio Inc \n",
|
||
"7 Arc System Works \n",
|
||
"8 Type-Moon \n",
|
||
"9 Idea Factory , Otomate \n",
|
||
"10 Idea Factory \n",
|
||
"11 GungHo Online Entertainment , Apollosoft , Chime \n",
|
||
"12 Idea Factory , Otomate , Comcept \n",
|
||
"\n",
|
||
" Platform ( s ) \n",
|
||
"0 PlayStation Portable \n",
|
||
"1 PlayStation Portable \n",
|
||
"2 PlayStation Portable ( PSN ) \n",
|
||
"3 PlayStation Portable \n",
|
||
"4 PlayStation Portable \n",
|
||
"5 PlayStation Portable \n",
|
||
"6 PlayStation Portable \n",
|
||
"7 PlayStation Portable \n",
|
||
"8 PlayStation Portable \n",
|
||
"9 PlayStation Portable \n",
|
||
"10 PlayStation Portable \n",
|
||
"11 PlayStation Portable \n",
|
||
"12 PlayStation Portable },\n",
|
||
" { 'answer': 'April 7 , 2009',\n",
|
||
" 'context': Title First release \\\n",
|
||
"0 Guilty Gear XX Accent Core Plus April 7 , 2009 \n",
|
||
"1 BlazBlue : Calamity Trigger Portable February 25 , 2010 \n",
|
||
"2 Cho Aniki Zero March 25 , 2010 \n",
|
||
"3 Mimana Iyar Chronicle March 30 , 2010 \n",
|
||
"4 Gladiator Begins September 14 , 2010 \n",
|
||
"5 Blazing Souls Accelate October 19 , 2010 \n",
|
||
"6 Jikandia : The Timeless Land March 15 , 2011 \n",
|
||
"7 BlazBlue : Continuum Shift II May 31 , 2011 \n",
|
||
"8 Fate/Extra November 1 , 2011 \n",
|
||
"9 Hakuoki : Demon of the Fleeting Blossom February 14 , 2012 \n",
|
||
"10 Hakuoki : Warriors of the Shinsengumi November 6 , 2012 \n",
|
||
"11 Ragnarok Tactics February 19 , 2013 \n",
|
||
"12 Sweet Fuse : At Your Side August 27 , 2013 \n",
|
||
"\n",
|
||
" Developer ( s ) \\\n",
|
||
"0 Arc System Works \n",
|
||
"1 Arc System Works \n",
|
||
"2 extreme Co. , Ltd \n",
|
||
"3 Kogado Studio , Premium Agency \n",
|
||
"4 Goshow \n",
|
||
"5 Neverland \n",
|
||
"6 Opus Studio Inc \n",
|
||
"7 Arc System Works \n",
|
||
"8 Type-Moon \n",
|
||
"9 Idea Factory , Otomate \n",
|
||
"10 Idea Factory \n",
|
||
"11 GungHo Online Entertainment , Apollosoft , Chime \n",
|
||
"12 Idea Factory , Otomate , Comcept \n",
|
||
"\n",
|
||
" Platform ( s ) \n",
|
||
"0 PlayStation Portable \n",
|
||
"1 PlayStation Portable \n",
|
||
"2 PlayStation Portable ( PSN ) \n",
|
||
"3 PlayStation Portable \n",
|
||
"4 PlayStation Portable \n",
|
||
"5 PlayStation Portable \n",
|
||
"6 PlayStation Portable \n",
|
||
"7 PlayStation Portable \n",
|
||
"8 PlayStation Portable \n",
|
||
"9 PlayStation Portable \n",
|
||
"10 PlayStation Portable \n",
|
||
"11 PlayStation Portable \n",
|
||
"12 PlayStation Portable },\n",
|
||
" { 'answer': 'November 15 , 2007',\n",
|
||
" 'context': Title First release \\\n",
|
||
"0 Hooked ! Real Motion Fishing October 30 , 2007 \n",
|
||
"1 Guilty Gear XX Accent Core November 15 , 2007 \n",
|
||
"2 MiniCopter : Adventure Flight April 11 , 2008 \n",
|
||
"3 River City Ransom April 21 , 2008 \n",
|
||
"4 Double Dragon April 28 , 2008 \n",
|
||
"5 Renegade May 5 , 2008 \n",
|
||
"6 Castle of Shikigami III May 13 , 2008 \n",
|
||
"7 Family Table Tennis May 26 , 2008 \n",
|
||
"8 Super Dodge Ball September 22 , 2008 \n",
|
||
"9 Family Glide Hockey January 19 , 2009 \n",
|
||
"10 Bit.Trip Beat March 16 , 2009 \n",
|
||
"11 Family Pirate Party May 11 , 2009 \n",
|
||
"12 Guilty Gear XX Accent Core Plus May 12 , 2009 \n",
|
||
"13 Family Mini Golf June 22 , 2009 \n",
|
||
"14 Bit.Trip Core July 6 , 2009 \n",
|
||
"15 Family Slot Car Racing August 17 , 2009 \n",
|
||
"16 Crash ' n the Boys : Street Challenge September 14 , 2009 \n",
|
||
"17 Family Tennis September 21 , 2009 \n",
|
||
"18 Family Card Games November 2 , 2009 \n",
|
||
"19 Hooked ! Again : Real Motion Fishing November 3 , 2009 \n",
|
||
"\n",
|
||
" Developer ( s ) Platform ( s ) \n",
|
||
"0 SIMS Wii \n",
|
||
"1 Arc System Works Wii \n",
|
||
"2 Sonic Powered Wii \n",
|
||
"3 Technos Wii ( Virtual Console ) \n",
|
||
"4 Technos Wii ( Virtual Console ) \n",
|
||
"5 Technos Wii ( Virtual Console ) \n",
|
||
"6 Alfa System Wii \n",
|
||
"7 Arc System Works Wii ( WiiWare ) \n",
|
||
"8 Technos Wii ( Virtual Console ) \n",
|
||
"9 Arc System Works Wii ( WiiWare ) \n",
|
||
"10 Gaijin Games Wii ( WiiWare ) \n",
|
||
"11 Arc System Works Wii ( WiiWare ) \n",
|
||
"12 Arc System Works Wii \n",
|
||
"13 Arc System Works Wii ( WiiWare ) \n",
|
||
"14 Gaijin Games Wii ( WiiWare ) \n",
|
||
"15 Arc System Works Wii ( WiiWare ) \n",
|
||
"16 Technos Wii ( Virtual Console ) \n",
|
||
"17 Arc System Works Wii ( WiiWare ) \n",
|
||
"18 Arc System Works Wii ( WiiWare ) \n",
|
||
"19 SIMS Co. , Ltd Wii },\n",
|
||
" { 'answer': '',\n",
|
||
" 'context': Game Publisher Release Date \\\n",
|
||
"0 Super Mario 64 Nintendo September 26 , 1996 \n",
|
||
"1 Wipeout XL/2097 Psygnosis September 30 , 1996 \n",
|
||
"2 Quake GT Interactive June 22 , 1996 \n",
|
||
"3 Civilization II MicroProse February 29 , 1996 \n",
|
||
"4 Tekken 2 Namco August 25 , 1996 \n",
|
||
"5 Wave Race 64 Nintendo November 1 , 1996 \n",
|
||
"6 Realms of the Haunting Interplay December 31 , 1996 \n",
|
||
"7 Tomb Raider Eidos Interactive October 25 , 1996 \n",
|
||
"8 Resident Evil Capcom March 30 , 1996 \n",
|
||
"9 Command & Conquer : Red Alert Virgin November 22 , 1996 \n",
|
||
"10 Dragon Force Sega November 30 , 1996 \n",
|
||
"11 Guardian Heroes Sega January 25 , 1996 \n",
|
||
"12 Super Mario RPG Nintendo March 9 , 1996 \n",
|
||
"13 Duke Nukem 3D GT Interactive January 29 , 1996 \n",
|
||
"14 NiGHTS into Dreams Sega July 5 , 1996 \n",
|
||
"15 Pilotwings 64 Nintendo September 26 , 1996 \n",
|
||
"16 Panzer Dragoon II Zwei Sega March 22 , 1996 \n",
|
||
"\n",
|
||
" Platform ( s ) MC score GR score \n",
|
||
"0 Nintendo 64 94/100 96.41% \n",
|
||
"1 PlayStation 93/100 94.75% \n",
|
||
"2 DOS 94/100 93.22% \n",
|
||
"3 Microsoft Windows 94/100 91.29% \n",
|
||
"4 PlayStation 89/100 92.50% \n",
|
||
"5 Nintendo 64 92/100 90.67% \n",
|
||
"6 Microsoft Windows nan 91.86% \n",
|
||
"7 PlayStation 91/100 90.02% \n",
|
||
"8 PlayStation 91/100 87.23% \n",
|
||
"9 DOS 90/100 90.91% \n",
|
||
"10 Sega Saturn nan 89.64% \n",
|
||
"11 Sega Saturn nan 89.20% \n",
|
||
"12 SNES nan 89.12% \n",
|
||
"13 DOS 89/100 88.50% \n",
|
||
"14 Sega Saturn nan 88.56% \n",
|
||
"15 Nintendo 64 80/100 87.52% \n",
|
||
"16 Sega Saturn nan 87.50% },\n",
|
||
" { 'answer': '',\n",
|
||
" 'context': Game Publisher Release Date \\\n",
|
||
"0 Super Mario 64 Nintendo September 26 , 1996 \n",
|
||
"1 Wipeout XL/2097 Psygnosis September 30 , 1996 \n",
|
||
"2 Quake GT Interactive June 22 , 1996 \n",
|
||
"3 Civilization II MicroProse February 29 , 1996 \n",
|
||
"4 Tekken 2 Namco August 25 , 1996 \n",
|
||
"5 Wave Race 64 Nintendo November 1 , 1996 \n",
|
||
"6 Realms of the Haunting Interplay December 31 , 1996 \n",
|
||
"7 Tomb Raider Eidos Interactive October 25 , 1996 \n",
|
||
"8 Resident Evil Capcom March 30 , 1996 \n",
|
||
"9 Command & Conquer : Red Alert Virgin November 22 , 1996 \n",
|
||
"10 Dragon Force Sega November 30 , 1996 \n",
|
||
"11 Guardian Heroes Sega January 25 , 1996 \n",
|
||
"12 Super Mario RPG Nintendo March 9 , 1996 \n",
|
||
"13 Duke Nukem 3D GT Interactive January 29 , 1996 \n",
|
||
"14 NiGHTS into Dreams Sega July 5 , 1996 \n",
|
||
"15 Pilotwings 64 Nintendo September 26 , 1996 \n",
|
||
"16 Panzer Dragoon II Zwei Sega March 22 , 1996 \n",
|
||
"\n",
|
||
" Platform ( s ) MC score GR score \n",
|
||
"0 Nintendo 64 94/100 96.41% \n",
|
||
"1 PlayStation 93/100 94.75% \n",
|
||
"2 DOS 94/100 93.22% \n",
|
||
"3 Microsoft Windows 94/100 91.29% \n",
|
||
"4 PlayStation 89/100 92.50% \n",
|
||
"5 Nintendo 64 92/100 90.67% \n",
|
||
"6 Microsoft Windows nan 91.86% \n",
|
||
"7 PlayStation 91/100 90.02% \n",
|
||
"8 PlayStation 91/100 87.23% \n",
|
||
"9 DOS 90/100 90.91% \n",
|
||
"10 Sega Saturn nan 89.64% \n",
|
||
"11 Sega Saturn nan 89.20% \n",
|
||
"12 SNES nan 89.12% \n",
|
||
"13 DOS 89/100 88.50% \n",
|
||
"14 Sega Saturn nan 88.56% \n",
|
||
"15 Nintendo 64 80/100 87.52% \n",
|
||
"16 Sega Saturn nan 87.50% },\n",
|
||
" { 'answer': 'September 12, 2001',\n",
|
||
" 'context': Country Date Label \\\n",
|
||
"0 United States September 12, 2001 Ma-Kahru / Profane Productions \n",
|
||
"1 Sweden 2004 Total Holocaust Records \n",
|
||
"2 Sweden 2004 Total Holocaust Records \n",
|
||
"3 France August 31, 2004 Debemur Morti Prod. \n",
|
||
"4 United States January 29, 2008 Hydra Head Records \n",
|
||
"\n",
|
||
" Format Catalog Nr. \n",
|
||
"0 mono CD-R (150 copies) profanecdr 001 \n",
|
||
"1 ed Remaster cassette thr-048 \n",
|
||
"2 ed Remaster CD (1000 copies) thr-050 \n",
|
||
"3 ed Remaster double-12\" (500 copies) DMP0003 \n",
|
||
"4 double CD HH666-150 },\n",
|
||
" { 'answer': 'September 12, 2001',\n",
|
||
" 'context': Country Date Label \\\n",
|
||
"0 United States September 12, 2001 Ma-Kahru / Profane Productions \n",
|
||
"1 Sweden 2004 Total Holocaust Records \n",
|
||
"2 Sweden 2004 Total Holocaust Records \n",
|
||
"3 France August 31, 2004 Debemur Morti Prod. \n",
|
||
"4 United States January 29, 2008 Hydra Head Records \n",
|
||
"\n",
|
||
" Format Catalog Nr. \n",
|
||
"0 mono CD-R (150 copies) profanecdr 001 \n",
|
||
"1 ed Remaster cassette thr-048 \n",
|
||
"2 ed Remaster CD (1000 copies) thr-050 \n",
|
||
"3 ed Remaster double-12\" (500 copies) DMP0003 \n",
|
||
"4 double CD HH666-150 },\n",
|
||
" { 'answer': '7 May 2013 (hardcover)',\n",
|
||
" 'context': # Title Publisher \\\n",
|
||
"0 1 Dead Until Dark Ace Books \n",
|
||
"1 2 Living Dead in Dallas Ace Books \n",
|
||
"2 3 Club Dead Ace Books \n",
|
||
"3 4 Dead to the World Ace Hardcover \n",
|
||
"4 5 Dead as a Doornail Ace Hardcover \n",
|
||
"5 6 Definitely Dead Ace Hardcover \n",
|
||
"6 7 All Together Dead Ace Hardcover \n",
|
||
"7 8 From Dead to Worse Ace Hardcover \n",
|
||
"8 9 Dead and Gone Ace Hardcover \n",
|
||
"9 10 Dead in the Family Ace Hardcover \n",
|
||
"10 11 Dead Reckoning Ace Hardcover \n",
|
||
"11 12 Deadlocked Ace Hardcover \n",
|
||
"12 13 Dead Ever After Ace Hardcover \n",
|
||
"\n",
|
||
" Release Length \\\n",
|
||
"0 May 2001 (paperback) January 2008 (hardcover) 291 pp \n",
|
||
"1 April 2002 (paperback) January 2009 (hardcover) 291 pp \n",
|
||
"2 May 2003 (paperback) March 2010 (hardcover) 292 pp \n",
|
||
"3 May 2004 (hardcover) May 2005 (paperback) 291 pp \n",
|
||
"4 May 2005 (hardcover) April 2006 (paperback) 295 pp \n",
|
||
"5 May 2006 (hardcover) March 2007 (paperback) 324 pp \n",
|
||
"6 May 2007 (hardcover) March 2008 (paperback) 336 pp \n",
|
||
"7 May 2008 (hardcover) March 2009 (paperback) 359 pp \n",
|
||
"8 May 2009 (hardcover) April 2010 (paperback) 312 pp \n",
|
||
"9 May 2010 (hardcover) March 2011 (paperback) 311 pp \n",
|
||
"10 May 2011 (hardcover) March 2012 (paperback) 325 pp \n",
|
||
"11 May 2012 (hardcover) March 2013 (paperback) 336 pp \n",
|
||
"12 7 May 2013 (hardcover) 352 pp \n",
|
||
"\n",
|
||
" Hardcover Paperback \n",
|
||
"0 ISBN 0-441-01597-2 ISBN 0-441-00853-4 \n",
|
||
"1 ISBN 0-441-01673-1 ISBN 0-441-00923-9 \n",
|
||
"2 ISBN 0-441-01910-2 ISBN 0-441-01051-2 \n",
|
||
"3 ISBN 0-441-01167-5 ISBN 0-441-01218-3 \n",
|
||
"4 ISBN 0-441-01279-5 ISBN 0-441-01333-3 \n",
|
||
"5 ISBN 0-441-01400-3 ISBN 0-441-01491-7 \n",
|
||
"6 ISBN 0-441-01494-1 ISBN 0-441-01581-6 \n",
|
||
"7 ISBN 0-441-01589-1 ISBN 0-441-01701-0 \n",
|
||
"8 ISBN 0-441-01715-0 ISBN 0-441-01851-3 \n",
|
||
"9 ISBN 0-441-01864-5 ISBN 0-441-02015-1 \n",
|
||
"10 ISBN 0-441-02031-3 ISBN 0-441-02060-7 \n",
|
||
"11 ISBN 1-937007-44-8 ISBN 0-425-25638-3 \n",
|
||
"12 ISBN 193700788X ISBN n/a },\n",
|
||
" { 'answer': '2012',\n",
|
||
" 'context': Title Year \\\n",
|
||
"0 The American Scream 2012 \n",
|
||
"1 Dead Souls 2012 \n",
|
||
"2 Ghoul 2012 \n",
|
||
"3 Beneath 2013 \n",
|
||
"4 Chilling Visions : 5 Senses of Fear 2013 \n",
|
||
"5 The Monkey 's Paw 2013 \n",
|
||
"6 Animal 2014 \n",
|
||
"7 Deep in the Darkness 2014 \n",
|
||
"8 The Boy 2015 \n",
|
||
"9 SiREN 2016 \n",
|
||
"10 Camera Obscura 2017 \n",
|
||
"11 Dementia 13 2017 \n",
|
||
"\n",
|
||
" Production Co \n",
|
||
"0 Chiller Films Brainstorm Media \n",
|
||
"1 Chiller Films Synthetic Productions \n",
|
||
"2 Chiller Films Modernciné \n",
|
||
"3 Glass Eye Pix \n",
|
||
"4 Chiller Films Synthetic Cinema International \n",
|
||
"5 TMP Films \n",
|
||
"6 Flower Films Synthetic Cinema International \n",
|
||
"7 Chiller Films Synthetic Cinema International \n",
|
||
"8 SpectreVision \n",
|
||
"9 Studio71 \n",
|
||
"10 Chiller Films Hood River Entertainment Paper Street Pictures \n",
|
||
"11 Pipeline Entertainment Haloran LLC },\n",
|
||
" { 'answer': '2010',\n",
|
||
" 'context': Title Year Other artist ( s ) \\\n",
|
||
"0 Count on You 2010 Big Time Rush \n",
|
||
"1 You Got ta Want It 2011 nan \n",
|
||
"2 Chocolate Brown Eyes 2013 Salaam Remi \n",
|
||
"3 Vertigo 2013 Jason Derulo \n",
|
||
"4 Vertigo 2014 Jason Derulo \n",
|
||
"5 Playing With Fire 2015 Thomas Rhett \n",
|
||
"6 Too Late for Love 2016 DJ Antoine \n",
|
||
"7 Water Guns 2016 Todrick Hall \n",
|
||
"8 Chasing 2017 Danny Gokey \n",
|
||
"\n",
|
||
" Album \n",
|
||
"0 BTR \n",
|
||
"1 Official Gameday Music of the NFL \n",
|
||
"2 One in the Chamber \n",
|
||
"3 Tattoos \n",
|
||
"4 Talk Dirty \n",
|
||
"5 Tangled Up \n",
|
||
"6 Provocateur \n",
|
||
"7 Straight Outta Oz \n",
|
||
"8 Rise },\n",
|
||
" { 'answer': '2017',\n",
|
||
" 'context': Year Title Role \\\n",
|
||
"0 2017 Mass Effect : Andromeda Various \n",
|
||
"1 2017 Lone Echo Hera \n",
|
||
"2 2017 Madden NFL 18 : Longshot Various \n",
|
||
"3 2017 FIFA 18 Beatriz Villanova \n",
|
||
"4 2017 Puzzle Fighter Additional Voices \n",
|
||
"5 2017 Need for Speed Payback Additional Voices \n",
|
||
"6 2018 Dragalia Lost Corsaint Phoenix / Kristy \n",
|
||
"7 2018 FIFA 19 Beatriz Villanova \n",
|
||
"8 2019 Crackdown 3 Additional Voices \n",
|
||
"9 2019 Anthem Princess Zhim \n",
|
||
"10 2019 FIFA 20 Beatriz Villanova \n",
|
||
"\n",
|
||
" Notes \n",
|
||
"0 Performance Capture Actor \n",
|
||
"1 Voice acting \n",
|
||
"2 Motion capture actor \n",
|
||
"3 Voice acting \n",
|
||
"4 nan \n",
|
||
"5 nan \n",
|
||
"6 Voice acting \n",
|
||
"7 Voice acting \n",
|
||
"8 nan \n",
|
||
"9 Voice acting \n",
|
||
"10 Voice acting },\n",
|
||
" { 'answer': '2017',\n",
|
||
" 'context': Year Title Role \\\n",
|
||
"0 2017 Mass Effect : Andromeda Various \n",
|
||
"1 2017 Lone Echo Hera \n",
|
||
"2 2017 Madden NFL 18 : Longshot Various \n",
|
||
"3 2017 FIFA 18 Beatriz Villanova \n",
|
||
"4 2017 Puzzle Fighter Additional Voices \n",
|
||
"5 2017 Need for Speed Payback Additional Voices \n",
|
||
"6 2018 Dragalia Lost Corsaint Phoenix / Kristy \n",
|
||
"7 2018 FIFA 19 Beatriz Villanova \n",
|
||
"8 2019 Crackdown 3 Additional Voices \n",
|
||
"9 2019 Anthem Princess Zhim \n",
|
||
"10 2019 FIFA 20 Beatriz Villanova \n",
|
||
"\n",
|
||
" Notes \n",
|
||
"0 Performance Capture Actor \n",
|
||
"1 Voice acting \n",
|
||
"2 Motion capture actor \n",
|
||
"3 Voice acting \n",
|
||
"4 nan \n",
|
||
"5 nan \n",
|
||
"6 Voice acting \n",
|
||
"7 Voice acting \n",
|
||
"8 nan \n",
|
||
"9 Voice acting \n",
|
||
"10 Voice acting },\n",
|
||
" { 'answer': 'May\\xa029,\\xa02018',\n",
|
||
" 'context': No.overall No. inseason Title Directed by \\\n",
|
||
"0 Part 1 Part 1 Part 1 Part 1 \n",
|
||
"1 69 1 Family Leave\"\" Troy Miller \n",
|
||
"2 70 2 Self-Deportation\"\" Troy Miller \n",
|
||
"3 71 3 Everyone Gets Atrophy\"\" Troy Miller \n",
|
||
"4 72 4 An Old Start\"\" Troy Miller \n",
|
||
"5 73 5 Sinking Feelings\"\" Troy Miller \n",
|
||
"6 74 6 Emotional Baggage\"\" Troy Miller \n",
|
||
"7 75 7 Rom-Traum\"\" Troy Miller \n",
|
||
"8 76 8 Premature Independence\"\" Troy Miller \n",
|
||
"\n",
|
||
" Written by Original release date Prod.code \\\n",
|
||
"0 Part 1 Part 1 Part 1 Part 1 \n",
|
||
"1 Mitchell Hurwitz & Jim Vallely May 29, 2018 5AJD01 nan \n",
|
||
"2 Richard Day May 29, 2018 5AJD02 nan \n",
|
||
"3 Mitchell Hurwitz May 29, 2018 5AJD03 nan \n",
|
||
"4 Jim Vallely May 29, 2018 5AJD04 nan \n",
|
||
"5 Jim Vallely & Mitchell Hurwitz May 29, 2018 5AJD05 nan \n",
|
||
"6 Evan Mann & Gareth Reynolds May 29, 2018 5AJD06 nan \n",
|
||
"7 Maggie Rowe May 29, 2018 5ADJ07 nan \n",
|
||
"8 Mitchell Hurwitz & Jim Vallely May 29, 2018 5ADJ08 nan \n",
|
||
"\n",
|
||
" \n",
|
||
"0 Part 1 Part 1 Part 1 Part 1 Part 1 \n",
|
||
"1 nan nan nan nan nan \n",
|
||
"2 nan nan nan nan nan \n",
|
||
"3 nan nan nan nan nan \n",
|
||
"4 nan nan nan nan nan \n",
|
||
"5 nan nan nan nan nan \n",
|
||
"6 nan nan nan nan nan \n",
|
||
"7 nan nan nan nan nan \n",
|
||
"8 nan nan nan nan nan },\n",
|
||
" { 'answer': '2009',\n",
|
||
" 'context': Title Year \\\n",
|
||
"0 Bomber Boy 1990 1991 \n",
|
||
"1 Bomberman GB / Wario Blast : Featuring Bomberman ! 1994 1995 \n",
|
||
"2 Bomberman GB 2 1995 1998 \n",
|
||
"3 Bomberman GB 3 1996 \n",
|
||
"4 Pocket Bomberman 1997 1998 \n",
|
||
"5 Bomberman Quest 1998 1999 \n",
|
||
"6 Bomberman Max 1999 2000 \n",
|
||
"7 Bomberman Story / Bomberman Tournament 2001 \n",
|
||
"8 Bomberman Max 2 2002 \n",
|
||
"9 Bomberman 2004 \n",
|
||
"10 Bomberman ( Nintendo DS ) 2005 \n",
|
||
"11 Bomberman 2006 2007 \n",
|
||
"12 Bomberman Story DS 2007 \n",
|
||
"13 Bomberman 2 2008 2009 \n",
|
||
"14 Bomberman Blitz 2009 \n",
|
||
"\n",
|
||
" Platforms \\\n",
|
||
"0 Game Boy \n",
|
||
"1 Game Boy \n",
|
||
"2 Game Boy \n",
|
||
"3 Game Boy \n",
|
||
"4 Game Boy , Game Boy Color \n",
|
||
"5 Game Boy Color \n",
|
||
"6 Game Boy Color \n",
|
||
"7 Game Boy Advance \n",
|
||
"8 Game Boy Advance \n",
|
||
"9 N-Gage \n",
|
||
"10 Nintendo DS \n",
|
||
"11 PlayStation Portable \n",
|
||
"12 Nintendo DS \n",
|
||
"13 Nintendo DS \n",
|
||
"14 DSiWare \n",
|
||
"\n",
|
||
" Notes \n",
|
||
"0 Known as Atomic Punk in North America and Dynablaster in Europe \n",
|
||
"1 Named Wario Blast : Featuring Bomberman ! outside of Japan ; also Nintendo '... \n",
|
||
"2 Named Bomberman GB in North America and Europe \n",
|
||
"3 Japan-only release ; released in Japan for Virtual Console \n",
|
||
"4 GBC release only in the US and in Europe \n",
|
||
"5 Action-adventure video game \n",
|
||
"6 Released in two variants , Red Challenger and Blue Champion editions \n",
|
||
"7 4-player support \n",
|
||
"8 Released in two variants , Blue Advance and Red Advance \n",
|
||
"9 2-player support over wireless play via Bluetooth . First title in the serie... \n",
|
||
"10 8-player support over wireless play , but no internet Wi-Fi support \n",
|
||
"11 4-player support over wireless play ; North America \n",
|
||
"12 4-player support over Wi-Fi connection \n",
|
||
"13 Named Custom Battler Bomberman in Japan \n",
|
||
"14 8-player support over wireless play and 4-player support over Wi-Fi connection },\n",
|
||
" { 'answer': '2009',\n",
|
||
" 'context': Title Year \\\n",
|
||
"0 Bomber Boy 1990 1991 \n",
|
||
"1 Bomberman GB / Wario Blast : Featuring Bomberman ! 1994 1995 \n",
|
||
"2 Bomberman GB 2 1995 1998 \n",
|
||
"3 Bomberman GB 3 1996 \n",
|
||
"4 Pocket Bomberman 1997 1998 \n",
|
||
"5 Bomberman Quest 1998 1999 \n",
|
||
"6 Bomberman Max 1999 2000 \n",
|
||
"7 Bomberman Story / Bomberman Tournament 2001 \n",
|
||
"8 Bomberman Max 2 2002 \n",
|
||
"9 Bomberman 2004 \n",
|
||
"10 Bomberman ( Nintendo DS ) 2005 \n",
|
||
"11 Bomberman 2006 2007 \n",
|
||
"12 Bomberman Story DS 2007 \n",
|
||
"13 Bomberman 2 2008 2009 \n",
|
||
"14 Bomberman Blitz 2009 \n",
|
||
"\n",
|
||
" Platforms \\\n",
|
||
"0 Game Boy \n",
|
||
"1 Game Boy \n",
|
||
"2 Game Boy \n",
|
||
"3 Game Boy \n",
|
||
"4 Game Boy , Game Boy Color \n",
|
||
"5 Game Boy Color \n",
|
||
"6 Game Boy Color \n",
|
||
"7 Game Boy Advance \n",
|
||
"8 Game Boy Advance \n",
|
||
"9 N-Gage \n",
|
||
"10 Nintendo DS \n",
|
||
"11 PlayStation Portable \n",
|
||
"12 Nintendo DS \n",
|
||
"13 Nintendo DS \n",
|
||
"14 DSiWare \n",
|
||
"\n",
|
||
" Notes \n",
|
||
"0 Known as Atomic Punk in North America and Dynablaster in Europe \n",
|
||
"1 Named Wario Blast : Featuring Bomberman ! outside of Japan ; also Nintendo '... \n",
|
||
"2 Named Bomberman GB in North America and Europe \n",
|
||
"3 Japan-only release ; released in Japan for Virtual Console \n",
|
||
"4 GBC release only in the US and in Europe \n",
|
||
"5 Action-adventure video game \n",
|
||
"6 Released in two variants , Red Challenger and Blue Champion editions \n",
|
||
"7 4-player support \n",
|
||
"8 Released in two variants , Blue Advance and Red Advance \n",
|
||
"9 2-player support over wireless play via Bluetooth . First title in the serie... \n",
|
||
"10 8-player support over wireless play , but no internet Wi-Fi support \n",
|
||
"11 4-player support over wireless play ; North America \n",
|
||
"12 4-player support over Wi-Fi connection \n",
|
||
"13 Named Custom Battler Bomberman in Japan \n",
|
||
"14 8-player support over wireless play and 4-player support over Wi-Fi connection },\n",
|
||
" { 'answer': '15 April 2005',\n",
|
||
" 'context': Release date Release title Country Publisher \\\n",
|
||
"0 1 January 2000 Martial Law: Shanghai Express Hong Kong Deltamac (HK) \n",
|
||
"1 15 April 2005 Martial Law: Diamond Fever Hong Kong Deltamac (HK) \n",
|
||
"2 15 April 2005 Martial Law: Dead Ringers Hong Kong Deltamac (HK) \n",
|
||
"3 15 April 2005 Martial Law: Funny Money Hong Kong Deltamac (HK) \n",
|
||
"4 15 April 2005 Martial Law: Extreme Mesures Hong Kong Deltamac (HK) \n",
|
||
"5 15 April 2005 Martial Law: Trackdown Hong Kong Deltamac (HK) \n",
|
||
"6 15 April 2005 Martial Law: Take Out Hong Kong Deltamac (HK) \n",
|
||
"7 15 April 2005 Martial Law: Lock-Up Hong Kong Deltamac (HK) \n",
|
||
"8 15 April 2005 Martial Law: Substitutes Hong Kong Deltamac (HK) \n",
|
||
"9 15 April 2005 Martial Law: Trifecta Hong Kong Deltamac (HK) \n",
|
||
"10 15 April 2005 Martial Law Collection Hong Kong Deltamac (HK) \n",
|
||
"\n",
|
||
" Format Language Subtitles Notes \n",
|
||
"0 NTSC English Traditional Chinese 1 VCD \n",
|
||
"1 NTSC English Traditional Chinese 1 VCD \n",
|
||
"2 NTSC English Traditional Chinese 1 VCD \n",
|
||
"3 NTSC English Traditional Chinese 1 VCD \n",
|
||
"4 NTSC English Traditional Chinese 1 VCD \n",
|
||
"5 NTSC English Traditional Chinese 1 VCD \n",
|
||
"6 NTSC English Traditional Chinese 1 VCD \n",
|
||
"7 NTSC English Traditional Chinese 1 VCD \n",
|
||
"8 NTSC English Traditional Chinese 1 VCD \n",
|
||
"9 NTSC English Traditional Chinese 1 VCD \n",
|
||
"10 NTSC English Traditional Chinese 10 VCD's },\n",
|
||
" { 'answer': '15 April 2005',\n",
|
||
" 'context': Release date Release title Country Publisher \\\n",
|
||
"0 1 January 2000 Martial Law: Shanghai Express Hong Kong Deltamac (HK) \n",
|
||
"1 15 April 2005 Martial Law: Diamond Fever Hong Kong Deltamac (HK) \n",
|
||
"2 15 April 2005 Martial Law: Dead Ringers Hong Kong Deltamac (HK) \n",
|
||
"3 15 April 2005 Martial Law: Funny Money Hong Kong Deltamac (HK) \n",
|
||
"4 15 April 2005 Martial Law: Extreme Mesures Hong Kong Deltamac (HK) \n",
|
||
"5 15 April 2005 Martial Law: Trackdown Hong Kong Deltamac (HK) \n",
|
||
"6 15 April 2005 Martial Law: Take Out Hong Kong Deltamac (HK) \n",
|
||
"7 15 April 2005 Martial Law: Lock-Up Hong Kong Deltamac (HK) \n",
|
||
"8 15 April 2005 Martial Law: Substitutes Hong Kong Deltamac (HK) \n",
|
||
"9 15 April 2005 Martial Law: Trifecta Hong Kong Deltamac (HK) \n",
|
||
"10 15 April 2005 Martial Law Collection Hong Kong Deltamac (HK) \n",
|
||
"\n",
|
||
" Format Language Subtitles Notes \n",
|
||
"0 NTSC English Traditional Chinese 1 VCD \n",
|
||
"1 NTSC English Traditional Chinese 1 VCD \n",
|
||
"2 NTSC English Traditional Chinese 1 VCD \n",
|
||
"3 NTSC English Traditional Chinese 1 VCD \n",
|
||
"4 NTSC English Traditional Chinese 1 VCD \n",
|
||
"5 NTSC English Traditional Chinese 1 VCD \n",
|
||
"6 NTSC English Traditional Chinese 1 VCD \n",
|
||
"7 NTSC English Traditional Chinese 1 VCD \n",
|
||
"8 NTSC English Traditional Chinese 1 VCD \n",
|
||
"9 NTSC English Traditional Chinese 1 VCD \n",
|
||
"10 NTSC English Traditional Chinese 10 VCD's },\n",
|
||
" { 'answer': '1985',\n",
|
||
" 'context': Year Film \\\n",
|
||
"0 1985 Krush Groove \n",
|
||
"1 1987 Disorderlies \n",
|
||
"2 1987 Dragnet \n",
|
||
"3 1987 The Monster Squad \n",
|
||
"4 1987 Police Academy 4 : Citizens on Patrol \n",
|
||
"5 1988 Colors \n",
|
||
"6 1988 A Nightmare on Elm Street 4 : The Dream Master \n",
|
||
"7 1988 A Nightmare on Elm Street 4 : The Dream Master \n",
|
||
"8 1989 Ghostbusters II \n",
|
||
"9 1989 Ghostbusters II \n",
|
||
"10 1990 Teenage Mutant Ninja Turtles \n",
|
||
"11 1991 The Addams Family \n",
|
||
"12 1991 Cool as Ice \n",
|
||
"13 1991 Popcorn \n",
|
||
"14 1991 Teenage Mutant Ninja Turtles II : The Secret of the Ooze \n",
|
||
"15 1992 Deep Cover \n",
|
||
"16 1992 Gladiator \n",
|
||
"17 1992 Juice \n",
|
||
"18 1992 Mo ' Money \n",
|
||
"19 1992 Trespass \n",
|
||
"\n",
|
||
" Song \\\n",
|
||
"0 Krush Groovin \n",
|
||
"1 Baby , You 're a Rich Man \n",
|
||
"2 City of Crime \n",
|
||
"3 The Monster Squad \n",
|
||
"4 Citizens on Patrol \n",
|
||
"5 Colors \n",
|
||
"6 A Nightmare on My Street \n",
|
||
"7 Are You Ready for Freddy \n",
|
||
"8 On Our Own \n",
|
||
"9 Ghostbusters \n",
|
||
"10 Turtle Power \n",
|
||
"11 Addams Groove \n",
|
||
"12 Cool as Ice ( Everybody Get Loose ) \n",
|
||
"13 Scary Scary Movies \n",
|
||
"14 Ninja Rap \n",
|
||
"15 Deep Cover \n",
|
||
"16 Gladiator \n",
|
||
"17 Juice ( Know the Ledge ) \n",
|
||
"18 Mo ' Money Groove \n",
|
||
"19 Trespass \n",
|
||
"\n",
|
||
" Artist \\\n",
|
||
"0 Run DMC , Sheila E. , Kurtis Blow , The Fat Boys \n",
|
||
"1 Fat Boys \n",
|
||
"2 Dan Aykroyd & Tom Hanks \n",
|
||
"3 The Monster Squad \n",
|
||
"4 Michael Winslow \n",
|
||
"5 Ice-T \n",
|
||
"6 DJ Jazzy Jeff & The Fresh Prince \n",
|
||
"7 The Fat Boys \n",
|
||
"8 Bobby Brown \n",
|
||
"9 Run DMC \n",
|
||
"10 Partners in Kryme \n",
|
||
"11 MC Hammer \n",
|
||
"12 Vanilla Ice ft. Naomi Campbell \n",
|
||
"13 Ossie D and Stevie G \n",
|
||
"14 Vanilla Ice \n",
|
||
"15 Dr. Dre ft. Snoop Dogg \n",
|
||
"16 3rd Bass \n",
|
||
"17 Eric B . & Rakim \n",
|
||
"18 Mo ' Money All-Stars \n",
|
||
"19 Ice Cube & Ice-T \n",
|
||
"\n",
|
||
" Notes \n",
|
||
"0 Potentially the first film with an associated hip hop song \n",
|
||
"1 Cover of Baby , You 're a Rich Man by The Beatles \n",
|
||
"2 Performed with Glenn Hughes of Deep Purple and Pat Thrall of the Pat Travers... \n",
|
||
"3 Written and Produced by Dick Rudolph and Michael Sembello \n",
|
||
"4 Performed with the LA Dream Team \n",
|
||
"5 # 70 on US Billboard Hot 100 \n",
|
||
"6 Unofficial tribute \n",
|
||
"7 Features singing from Robert Englund as Freddy Krueger \n",
|
||
"8 # 1 on US Billboard R & B \n",
|
||
"9 Written by Ray Parker , Jr \n",
|
||
"10 # 13 on US Billboard Hot 100 \n",
|
||
"11 # 7 on US Billboard Hot 100 \n",
|
||
"12 # 81 on US Billboard Hot 100 \n",
|
||
"13 Lyrics by Alan Ormsby ( as Tod Hackett ) , Paul Zaza ( as Paul J. Zaza ) and... \n",
|
||
"14 Also performed live in-film in Vanilla Ice 's film debut \n",
|
||
"15 Snoop Dogg 's first appearance on record \n",
|
||
"16 The final appearance of 3rd Bass as a group \n",
|
||
"17 nan \n",
|
||
"18 nan \n",
|
||
"19 nan },\n",
|
||
" { 'answer': '1985',\n",
|
||
" 'context': Year Film \\\n",
|
||
"0 1985 Krush Groove \n",
|
||
"1 1987 Disorderlies \n",
|
||
"2 1987 Dragnet \n",
|
||
"3 1987 The Monster Squad \n",
|
||
"4 1987 Police Academy 4 : Citizens on Patrol \n",
|
||
"5 1988 Colors \n",
|
||
"6 1988 A Nightmare on Elm Street 4 : The Dream Master \n",
|
||
"7 1988 A Nightmare on Elm Street 4 : The Dream Master \n",
|
||
"8 1989 Ghostbusters II \n",
|
||
"9 1989 Ghostbusters II \n",
|
||
"10 1990 Teenage Mutant Ninja Turtles \n",
|
||
"11 1991 The Addams Family \n",
|
||
"12 1991 Cool as Ice \n",
|
||
"13 1991 Popcorn \n",
|
||
"14 1991 Teenage Mutant Ninja Turtles II : The Secret of the Ooze \n",
|
||
"15 1992 Deep Cover \n",
|
||
"16 1992 Gladiator \n",
|
||
"17 1992 Juice \n",
|
||
"18 1992 Mo ' Money \n",
|
||
"19 1992 Trespass \n",
|
||
"\n",
|
||
" Song \\\n",
|
||
"0 Krush Groovin \n",
|
||
"1 Baby , You 're a Rich Man \n",
|
||
"2 City of Crime \n",
|
||
"3 The Monster Squad \n",
|
||
"4 Citizens on Patrol \n",
|
||
"5 Colors \n",
|
||
"6 A Nightmare on My Street \n",
|
||
"7 Are You Ready for Freddy \n",
|
||
"8 On Our Own \n",
|
||
"9 Ghostbusters \n",
|
||
"10 Turtle Power \n",
|
||
"11 Addams Groove \n",
|
||
"12 Cool as Ice ( Everybody Get Loose ) \n",
|
||
"13 Scary Scary Movies \n",
|
||
"14 Ninja Rap \n",
|
||
"15 Deep Cover \n",
|
||
"16 Gladiator \n",
|
||
"17 Juice ( Know the Ledge ) \n",
|
||
"18 Mo ' Money Groove \n",
|
||
"19 Trespass \n",
|
||
"\n",
|
||
" Artist \\\n",
|
||
"0 Run DMC , Sheila E. , Kurtis Blow , The Fat Boys \n",
|
||
"1 Fat Boys \n",
|
||
"2 Dan Aykroyd & Tom Hanks \n",
|
||
"3 The Monster Squad \n",
|
||
"4 Michael Winslow \n",
|
||
"5 Ice-T \n",
|
||
"6 DJ Jazzy Jeff & The Fresh Prince \n",
|
||
"7 The Fat Boys \n",
|
||
"8 Bobby Brown \n",
|
||
"9 Run DMC \n",
|
||
"10 Partners in Kryme \n",
|
||
"11 MC Hammer \n",
|
||
"12 Vanilla Ice ft. Naomi Campbell \n",
|
||
"13 Ossie D and Stevie G \n",
|
||
"14 Vanilla Ice \n",
|
||
"15 Dr. Dre ft. Snoop Dogg \n",
|
||
"16 3rd Bass \n",
|
||
"17 Eric B . & Rakim \n",
|
||
"18 Mo ' Money All-Stars \n",
|
||
"19 Ice Cube & Ice-T \n",
|
||
"\n",
|
||
" Notes \n",
|
||
"0 Potentially the first film with an associated hip hop song \n",
|
||
"1 Cover of Baby , You 're a Rich Man by The Beatles \n",
|
||
"2 Performed with Glenn Hughes of Deep Purple and Pat Thrall of the Pat Travers... \n",
|
||
"3 Written and Produced by Dick Rudolph and Michael Sembello \n",
|
||
"4 Performed with the LA Dream Team \n",
|
||
"5 # 70 on US Billboard Hot 100 \n",
|
||
"6 Unofficial tribute \n",
|
||
"7 Features singing from Robert Englund as Freddy Krueger \n",
|
||
"8 # 1 on US Billboard R & B \n",
|
||
"9 Written by Ray Parker , Jr \n",
|
||
"10 # 13 on US Billboard Hot 100 \n",
|
||
"11 # 7 on US Billboard Hot 100 \n",
|
||
"12 # 81 on US Billboard Hot 100 \n",
|
||
"13 Lyrics by Alan Ormsby ( as Tod Hackett ) , Paul Zaza ( as Paul J. Zaza ) and... \n",
|
||
"14 Also performed live in-film in Vanilla Ice 's film debut \n",
|
||
"15 Snoop Dogg 's first appearance on record \n",
|
||
"16 The final appearance of 3rd Bass as a group \n",
|
||
"17 nan \n",
|
||
"18 nan \n",
|
||
"19 nan },\n",
|
||
" { 'answer': '1991',\n",
|
||
" 'context': Year Film Song \\\n",
|
||
"0 1991 House Party 2 Ai n't Gon na Hurt Nobody \n",
|
||
"1 1991 Nothing But Trouble Same Song \n",
|
||
"2 1994 Above the Rim Regulate \n",
|
||
"3 1994 Street Fighter Something Kinda Funky \n",
|
||
"4 1995 Friday Keep Their Heads Ringin \n",
|
||
"5 1999 Office Space Shove This Jay-Oh-Bee \n",
|
||
"6 2001 The Wash Bad Intentions \n",
|
||
"7 2002 8 Mile Lose Yourself \n",
|
||
"8 2002 Like Mike Basketball \n",
|
||
"9 2002 Like Mike Take Ya Home \n",
|
||
"10 2003 2 Fast 2 Furious Act a Fool \n",
|
||
"\n",
|
||
" Artist \n",
|
||
"0 Kid ' n Play \n",
|
||
"1 Digital Underground ft. 2Pac \n",
|
||
"2 Warren G ft. Nate Dogg \n",
|
||
"3 Rally Ral \n",
|
||
"4 Dr. Dre \n",
|
||
"5 Canibus and Biz Markie \n",
|
||
"6 Dr. Dre ft. Knoc-turn'al \n",
|
||
"7 Eminem \n",
|
||
"8 Lil ' Bow Wow ft. Fundisha , Jermaine Dupri , and Fabolous \n",
|
||
"9 Lil ' Bow Wow \n",
|
||
"10 Ludacris },\n",
|
||
" { 'answer': '1987 1988 1989',\n",
|
||
" 'context': Title Year \\\n",
|
||
"0 Bomber King / RoboWarrior 1987 1988 1989 \n",
|
||
"1 Bomber King : Scenario 2 / Blaster Master Boy/Jr 1991 1992 \n",
|
||
"2 Bomberman : Panic Bomber 1994 1995 \n",
|
||
"3 Bomberman B-Daman 1996 \n",
|
||
"4 Atomic Bomberman 1997 \n",
|
||
"5 Bomberman Wars 1998 \n",
|
||
"6 Bomberman Fantasy Race 1998 1999 2000 \n",
|
||
"7 Bomberman B-Daman Bakugaiden : The Road to Victory 1999 \n",
|
||
"8 Bomberman B-Daman Bakugaiden V : Final Mega Tune 2000 \n",
|
||
"9 Bomberman Kart 2001 2003 \n",
|
||
"10 Bomberman Jetters : The Legendary Bomberman 2002 \n",
|
||
"11 Bomberman Jetters 2002 2004 \n",
|
||
"12 Bomberman Jetters Game Collection 2003 \n",
|
||
"13 DreamMix TV World Fighters 2003 \n",
|
||
"14 BoBomberman 2004 \n",
|
||
"15 Bomberman Battles / Bomberman Hardball 2004 2005 \n",
|
||
"16 Bomberman : Bakufuu Sentai Bombermen 2006 \n",
|
||
"17 Bomberman : Act Zero 2006 \n",
|
||
"18 Bomberman : Disney Stitch Edition 2010 \n",
|
||
"19 Bomberman : Chains 2011 \n",
|
||
"\n",
|
||
" Platforms \\\n",
|
||
"0 Famicom / NES , MSX \n",
|
||
"1 Game Boy \n",
|
||
"2 PC Engine CD , Neo Geo , Super Famicom , NEC PC-9821 , FM Towns , Sharp X680... \n",
|
||
"3 Super Famicom \n",
|
||
"4 PC ( Windows ) \n",
|
||
"5 PlayStation , Sega Saturn \n",
|
||
"6 PlayStation \n",
|
||
"7 Game Boy Color \n",
|
||
"8 Game Boy Color \n",
|
||
"9 PlayStation 2 \n",
|
||
"10 Game Boy Advance \n",
|
||
"11 GameCube , PlayStation 2 \n",
|
||
"12 Game Boy Advance \n",
|
||
"13 GameCube , PlayStation 2 \n",
|
||
"14 Game Boy Advance \n",
|
||
"15 PlayStation 2 \n",
|
||
"16 PlayStation Portable \n",
|
||
"17 Xbox 360 \n",
|
||
"18 Mobile Phone \n",
|
||
"19 iOS \n",
|
||
"\n",
|
||
" Notes \n",
|
||
"0 Released outside Japan under the name RoboWarrior ; Bomberman-like progressi... \n",
|
||
"1 Sequel to Bomber King ; slightly altered and released by Sunsoft in America ... \n",
|
||
"2 Puzzle game , similar to Puyo Puyo and Tetris ; all versions except for Neo ... \n",
|
||
"3 Japan-only , part of the B-Daman series \n",
|
||
"4 10-player support through IPX networking ; first Bomberman title for Windows... \n",
|
||
"5 Japan-only release ; tactical role-playing game ( TRPG ) \n",
|
||
"6 Racing game \n",
|
||
"7 Japan-only release ; based on the anime series , Bomberman B-Daman Bakugaide... \n",
|
||
"8 Japan-only release ; based on the anime series , Bomberman B-Daman Bakugaide... \n",
|
||
"9 Released in Japan and PAL regions only ; kart racing game \n",
|
||
"10 Japan-only release ; based on the anime series , Bomberman Jetters \n",
|
||
"11 PS2 release was Japan-only ; based on the Bomberman Jetters anime series \n",
|
||
"12 Japan-only release ; based on the anime series , Bomberman Jetters \n",
|
||
"13 Released in Japan only ; crossover fighting game featuring Bomberman as a pl... \n",
|
||
"14 Minigame based on the NES version of Bomberman , but using characters from t... \n",
|
||
"15 Released in Japan and PAL regions only ; sports and party game \n",
|
||
"16 Japan-only release \n",
|
||
"17 Realistic re-envisioning of the character \n",
|
||
"18 A Bomberman Game based on the anime Stitch ! \n",
|
||
"19 Puzzle game , similar to Bejeweled },\n",
|
||
" { 'answer': '18 October 1999',\n",
|
||
" 'context': Region Date Label Format \\\n",
|
||
"0 United Kingdom 18 October 1999 Chemikal Underground Promo CD \n",
|
||
"1 United Kingdom 18 October 1999 Chemikal Underground CD \n",
|
||
"2 United Kingdom 18 October 1999 Chemikal Underground 12\" \n",
|
||
"3 United States 18 August 1998 Matador CD \n",
|
||
"4 Australia , New Zealand 1999 Spunk CD \n",
|
||
"\n",
|
||
" Catalog \n",
|
||
"0 PCHEM036CD \n",
|
||
"1 CHEM036CD \n",
|
||
"2 CHEM036 \n",
|
||
"3 OLE412 \n",
|
||
"4 URA012 },\n",
|
||
" { 'answer': 'January 31',\n",
|
||
" 'context': Release Title System \\\n",
|
||
"0 January 25 Guardian Heroes Sat \n",
|
||
"1 January 26 Mystaria : The Realms of Lore Sat \n",
|
||
"2 January 29 Duke Nukem 3D DOS \n",
|
||
"3 January 31 Mega Man X3 SNES \n",
|
||
"4 February 9 Bahamut Lagoon SNES \n",
|
||
"5 February 23 Front Mission : Gun Hazard SNES \n",
|
||
"6 February 27 Pokémon Red and Green GB \n",
|
||
"7 February 29 Civilization II Win \n",
|
||
"8 February 29 Ripper ( video game ) DOS \n",
|
||
"9 February 29 Rise 2 : Resurrection Win , Sat , PS1 \n",
|
||
"10 February 29 Terra Nova : Strike Force Centauri DOS \n",
|
||
"11 February 29 Zork : Nemesis Win \n",
|
||
"12 March 9 Super Mario RPG SNES \n",
|
||
"13 March 21 Kirby Super Star SNES \n",
|
||
"14 March 22 Resident Evil PS1 \n",
|
||
"15 March 22 Panzer Dragoon II Zwei Sat \n",
|
||
"16 March 29 Dragon Ball Z : Hyper Dimension SNES \n",
|
||
"17 April 20 Barbie Fashion Designer Win \n",
|
||
"18 April 26 Jumping Flash ! 2 PS1 \n",
|
||
"19 April 26 The Legend of Oasis Sat \n",
|
||
"\n",
|
||
" Developer / Publisher \\\n",
|
||
"0 Treasure / Sega \n",
|
||
"1 Micro Cabin / Sega \n",
|
||
"2 3D Realms / GT Interactive \n",
|
||
"3 Capcom \n",
|
||
"4 SquareSoft \n",
|
||
"5 SquareSoft \n",
|
||
"6 Nintendo \n",
|
||
"7 MicroProse \n",
|
||
"8 Take Two Interactive \n",
|
||
"9 Mirage / Acclaim \n",
|
||
"10 Looking Glass Studios \n",
|
||
"11 Activision \n",
|
||
"12 SquareSoft/Nintendo \n",
|
||
"13 HAL Labs / Nintendo \n",
|
||
"14 Capcom \n",
|
||
"15 Team Andromeda / Sega \n",
|
||
"16 TOSE / Bandai \n",
|
||
"17 Digital Domain / Mattel Media \n",
|
||
"18 Exact / SCEA \n",
|
||
"19 Sega / Ancient \n",
|
||
"\n",
|
||
" Notes \n",
|
||
"0 a beat-em-up game developed by Treasure \n",
|
||
"1 a tactical RPG \n",
|
||
"2 a popular first person shooter \n",
|
||
"3 third X installment in popular Mega Man franchise \n",
|
||
"4 Tactical RPG spin-off in the Final Fantasy series , before Final Fantasy Tac... \n",
|
||
"5 Sequel to strategy Super Famicom RPG Front Mission \n",
|
||
"6 launched a wildly popular game series \n",
|
||
"7 acclaimed sequel to the highly influential 1991 4X game \n",
|
||
"8 Interactive movie , Point-and-click adventure Single Player game \n",
|
||
"9 the sequel to the fighting game , Rise of the Robots \n",
|
||
"10 critically acclaimed FPS \n",
|
||
"11 11th game in the Zork series , employing 360-degree views of environment \n",
|
||
"12 beginning of the long-running series of Mario RPGs \n",
|
||
"13 considered to be one of the best games in the Kirby franchise \n",
|
||
"14 one of the foundational games in the survival horror genre , for a time it h... \n",
|
||
"15 an acclaimed rail shooter \n",
|
||
"16 the last Super Famicom game in the Dragon Ball Z franchise \n",
|
||
"17 The game 's strong sales sparked a renewed interest in developing games targ... \n",
|
||
"18 Sequel to the first true 3D platformer \n",
|
||
"19 Prequel to the Genesis Zelda-style action game Beyond Oasis },\n",
|
||
" { 'answer': 'Windows:NA: October 17, 2006 EU: October 20, 2006 Mac OS '\n",
|
||
" 'X:November 6, 2006',\n",
|
||
" 'context': Name \\\n",
|
||
"0 University \n",
|
||
"1 Nightlife \n",
|
||
"2 Open for Business \n",
|
||
"3 Pets \n",
|
||
"4 Seasons \n",
|
||
"5 Bon Voyage \n",
|
||
"6 FreeTime \n",
|
||
"7 Apartment Life \n",
|
||
"\n",
|
||
" Release date \\\n",
|
||
"0 Windows:NA: March 1, 2005 EU: March 2, 2005 Mac OS X:December 12, 2005 \n",
|
||
"1 Windows:NA: September 13, 2005 EU: September 13, 2005 Mac OS X:March 27, 2006 \n",
|
||
"2 Windows:NA: March 2, 2006 EU: March 2, 2006 Mac OS X:September 4, 2006 \n",
|
||
"3 Windows:NA: October 17, 2006 EU: October 20, 2006 Mac OS X:November 6, 2006 \n",
|
||
"4 Windows:NA: March 1, 2007 EU: March 2, 2007 Mac OS X:June 11, 2007 \n",
|
||
"5 Windows:NA: September 4, 2007 EU: September 7, 2007 Mac OS X:December 17, 2007 \n",
|
||
"6 Windows:NA: February 26, 2008 EU: February 22, 2008 \n",
|
||
"7 Windows:NA: August 27, 2008EU: August 29, 2008 \n",
|
||
"\n",
|
||
" Major Additions \\\n",
|
||
"0 Universities, Young Adult age group, Influence system \n",
|
||
"1 Dates, Groups system, Outings, Pleasure and Grilled Cheese aspiration, New r... \n",
|
||
"2 Businesses, talent badges \n",
|
||
"3 Ownable Pets \n",
|
||
"4 Weather system, Seasons, fishing, new talent badges,gardening \n",
|
||
"5 Vacations in different cultural areas \n",
|
||
"6 Hobby system, lifetime aspiration system, new talent badges. \n",
|
||
"7 Rentable apartments, reputation system, witchcraft system \n",
|
||
"\n",
|
||
" Neighborhoods \\\n",
|
||
"0 Campus:La Fiesta Tech,Sim State University,Académie Le Tour \n",
|
||
"1 Downtown:Downtown \n",
|
||
"2 Shopping District:Bluewater Village \n",
|
||
"3 None \n",
|
||
"4 Main:Riverblossom Hills \n",
|
||
"5 Vacation:Twikkii Island,Three Lakes,Takemizu Village \n",
|
||
"6 Main: Desiderata Valley Secret:Hobby \n",
|
||
"7 Main:Belladonna Cove[53]Secret:The Magical World \n",
|
||
"\n",
|
||
" New NPCs \\\n",
|
||
"0 Barista, Bartender,Cafeteria Worker,Cheerleader,Coach, Evil Mascot, Mascot,P... \n",
|
||
"1 Gypsy Matchmaker,Waiter, Chef,Bartender, DJ,Mrs. Crumplebottom,Vampires (Cou... \n",
|
||
"2 Reporters,Barbers \n",
|
||
"3 Animal Control Officers,Obedience Trainer,Wolves, Skunks \n",
|
||
"4 Garden Club Members,Penguins \n",
|
||
"5 Fire Dancers,Hotel Maids,Bellboys, Masseurs,Wise Old Man,Pirate, Tour Guides... \n",
|
||
"6 Hobby Members,Rod Humble,Hobby Leaders,Food Judge,Genie \n",
|
||
"7 Butler, Landlord,Roomies,Breakdancers,Street Performers,Social Group Sims,Hi... \n",
|
||
"\n",
|
||
" New Lifestate/Creature \\\n",
|
||
"0 Zombies (Also in FreeTime and Apartment Life) \n",
|
||
"1 Vampires \n",
|
||
"2 Servos (Robots) \n",
|
||
"3 Werewolves \n",
|
||
"4 PlantSims \n",
|
||
"5 Bigfoot \n",
|
||
"6 Genie (Only NPC) \n",
|
||
"7 Witches, Warlocks \n",
|
||
"\n",
|
||
" New Careers \n",
|
||
"0 Natural Scientist, Paranormal,Show Business, Artist \n",
|
||
"1 None \n",
|
||
"2 Shop Employees \n",
|
||
"3 Pet careers:Security,Showbiz,Service \n",
|
||
"4 Adventurer,Education,Gamer,Journalism,Law, Music \n",
|
||
"5 None \n",
|
||
"6 Oceanography,Intelligence,Entertainment,Dance,Architecture \n",
|
||
"7 None },\n",
|
||
" { 'answer': '1973',\n",
|
||
" 'context': Year Title US CAN Notes\n",
|
||
"0 1973 Bachman-Turner Overdrive 70 9.0 CAN : Platinum US : Gold\n",
|
||
"1 1973 Bachman-Turner Overdrive II 4 6.0 CAN : Platinum US : Gold\n",
|
||
"2 1974 Not Fragile 1 1.0 CAN : Platinum US : Gold\n",
|
||
"3 1975 Four Wheel Drive 5 2.0 CAN : Platinum US : Gold\n",
|
||
"4 1975 Head On 23 3.0 CAN : Platinum US : Gold\n",
|
||
"5 1977 Freeways 70 34.0 CAN : Gold\n",
|
||
"6 1978 Street Action 130 62.0 nan\n",
|
||
"7 1979 Rock n ' Roll Nights 165 nan nan\n",
|
||
"8 1984 Bachman-Turner Overdrive 191 87.0 nan},\n",
|
||
" { 'answer': '2012',\n",
|
||
" 'context': Year Title \\\n",
|
||
"0 2011 Skylanders : Spyro 's Adventure \n",
|
||
"1 2012 The Expendables 2 Videogame \n",
|
||
"2 2012 Skylanders : Giants \n",
|
||
"3 2013 Skylanders : Swap Force \n",
|
||
"4 2014 Scooby-Doo and Looney Tunes : Cartoon Universe \n",
|
||
"5 2014 Skylanders : Trap Team \n",
|
||
"6 2015 Skylanders : SuperChargers \n",
|
||
"7 2016 Skylanders : Imaginators \n",
|
||
"8 2018 Lego The Incredibles \n",
|
||
"\n",
|
||
" Role \n",
|
||
"0 Zap \n",
|
||
"1 Barney Ross \n",
|
||
"2 Zap \n",
|
||
"3 Zap \n",
|
||
"4 Bugs Bunny Daffy Duck Foghorn Leghorn Sylvester \n",
|
||
"5 Zap \n",
|
||
"6 Zap \n",
|
||
"7 Zap \n",
|
||
"8 Bob Parr/Mr . Incredible },\n",
|
||
" { 'answer': 'JP : 1998',\n",
|
||
" 'context': Title \\\n",
|
||
"0 Itadaki Street : Watashi no Omise ni Yottette \n",
|
||
"1 Itadaki Street 2 : Neon Sign wa Bara Iro ni \n",
|
||
"2 Itadaki Street : Gorgeous King \n",
|
||
"3 Itadaki Street 3 Okumanchouja ni Shite Ageru : Kateikyoushi Tsuki \n",
|
||
"4 Dragon Quest & Final Fantasy in Itadaki Street Special \n",
|
||
"5 Dragon Quest & Final Fantasy in Itadaki Street Portable \n",
|
||
"6 Itadaki Street DS \n",
|
||
"7 Itadaki Street Mobile \n",
|
||
"8 Dragon Quest & Final Fantasy in Itadaki Street Mobile \n",
|
||
"9 Fortune Street Released in Japan as Itadaki Street Wii ( いただきストリートWii ) and ... \n",
|
||
"10 Fortune Street Smart Released in Japan as Itadaki Street for Smartphone ( いた... \n",
|
||
"11 Itadaki Street : Dragon Quest and Final Fantasy 30th Anniversary \n",
|
||
"\n",
|
||
" Year \\\n",
|
||
"0 JP : 1991 \n",
|
||
"1 JP : 1994 \n",
|
||
"2 JP : 1998 \n",
|
||
"3 JP : 2002 \n",
|
||
"4 JP : 2004 \n",
|
||
"5 JP : 2006 \n",
|
||
"6 JP : 2007 \n",
|
||
"7 JP : 2007 \n",
|
||
"8 JP : 2010 \n",
|
||
"9 JP : 2011-12-01 NA : 2011-12-05 EU : 2011-12-23 / 2012-01-06 AU : 2012-01-05 \n",
|
||
"10 JP : 2012 WW : 2012 \n",
|
||
"11 JP : 2017 \n",
|
||
"\n",
|
||
" Platform \\\n",
|
||
"0 Famicom \n",
|
||
"1 Super Famicom \n",
|
||
"2 PlayStation \n",
|
||
"3 PlayStation 2 \n",
|
||
"4 PlayStation 2 \n",
|
||
"5 PlayStation Portable \n",
|
||
"6 Nintendo DS \n",
|
||
"7 Mobile phones \n",
|
||
"8 Mobile phones \n",
|
||
"9 Wii \n",
|
||
"10 Android , iOS \n",
|
||
"11 PlayStation 4 , PlayStation Vita \n",
|
||
"\n",
|
||
" Notes \n",
|
||
"0 Itadaki Street : Watashi no Omise ni Yottette was developed by Loginsoft and... \n",
|
||
"1 Itadaki Street 2 : Neon Sign wa Bara Iro ni operates like a junior version o... \n",
|
||
"2 Itadaki Street : Gorgeous King was released on the PlayStation in 1998 . It ... \n",
|
||
"3 Itadaki Street 3 Okumanchouja ni Shite Ageru : Kateikyoushi Tsuki was develo... \n",
|
||
"4 Dragon Quest & Final Fantasy in Itadaki Street Special was released on Decem... \n",
|
||
"5 Dragon Quest & Final Fantasy in Itadaki Street Portable includes characters ... \n",
|
||
"6 Itadaki Street DS includes characters from Square Enix 's Dragon Quest serie... \n",
|
||
"7 Itadaki Street Mobile included no branded characters from any video game fra... \n",
|
||
"8 Dragon Quest & Final Fantasy in Itadaki Street Mobile features Final Fantasy... \n",
|
||
"9 Fortune Street was revealed by Nintendo at E3 2011 for the Wii , released on... \n",
|
||
"10 Fortune Street Smart is an entry in the series developed for smartphones . I... \n",
|
||
"11 Developed by Tose and released in Japan on October 19 , 2017 },\n",
|
||
" { 'answer': 'JP : 1998',\n",
|
||
" 'context': Title \\\n",
|
||
"0 Itadaki Street : Watashi no Omise ni Yottette \n",
|
||
"1 Itadaki Street 2 : Neon Sign wa Bara Iro ni \n",
|
||
"2 Itadaki Street : Gorgeous King \n",
|
||
"3 Itadaki Street 3 Okumanchouja ni Shite Ageru : Kateikyoushi Tsuki \n",
|
||
"4 Dragon Quest & Final Fantasy in Itadaki Street Special \n",
|
||
"5 Dragon Quest & Final Fantasy in Itadaki Street Portable \n",
|
||
"6 Itadaki Street DS \n",
|
||
"7 Itadaki Street Mobile \n",
|
||
"8 Dragon Quest & Final Fantasy in Itadaki Street Mobile \n",
|
||
"9 Fortune Street Released in Japan as Itadaki Street Wii ( いただきストリートWii ) and ... \n",
|
||
"10 Fortune Street Smart Released in Japan as Itadaki Street for Smartphone ( いた... \n",
|
||
"11 Itadaki Street : Dragon Quest and Final Fantasy 30th Anniversary \n",
|
||
"\n",
|
||
" Year \\\n",
|
||
"0 JP : 1991 \n",
|
||
"1 JP : 1994 \n",
|
||
"2 JP : 1998 \n",
|
||
"3 JP : 2002 \n",
|
||
"4 JP : 2004 \n",
|
||
"5 JP : 2006 \n",
|
||
"6 JP : 2007 \n",
|
||
"7 JP : 2007 \n",
|
||
"8 JP : 2010 \n",
|
||
"9 JP : 2011-12-01 NA : 2011-12-05 EU : 2011-12-23 / 2012-01-06 AU : 2012-01-05 \n",
|
||
"10 JP : 2012 WW : 2012 \n",
|
||
"11 JP : 2017 \n",
|
||
"\n",
|
||
" Platform \\\n",
|
||
"0 Famicom \n",
|
||
"1 Super Famicom \n",
|
||
"2 PlayStation \n",
|
||
"3 PlayStation 2 \n",
|
||
"4 PlayStation 2 \n",
|
||
"5 PlayStation Portable \n",
|
||
"6 Nintendo DS \n",
|
||
"7 Mobile phones \n",
|
||
"8 Mobile phones \n",
|
||
"9 Wii \n",
|
||
"10 Android , iOS \n",
|
||
"11 PlayStation 4 , PlayStation Vita \n",
|
||
"\n",
|
||
" Notes \n",
|
||
"0 Itadaki Street : Watashi no Omise ni Yottette was developed by Loginsoft and... \n",
|
||
"1 Itadaki Street 2 : Neon Sign wa Bara Iro ni operates like a junior version o... \n",
|
||
"2 Itadaki Street : Gorgeous King was released on the PlayStation in 1998 . It ... \n",
|
||
"3 Itadaki Street 3 Okumanchouja ni Shite Ageru : Kateikyoushi Tsuki was develo... \n",
|
||
"4 Dragon Quest & Final Fantasy in Itadaki Street Special was released on Decem... \n",
|
||
"5 Dragon Quest & Final Fantasy in Itadaki Street Portable includes characters ... \n",
|
||
"6 Itadaki Street DS includes characters from Square Enix 's Dragon Quest serie... \n",
|
||
"7 Itadaki Street Mobile included no branded characters from any video game fra... \n",
|
||
"8 Dragon Quest & Final Fantasy in Itadaki Street Mobile features Final Fantasy... \n",
|
||
"9 Fortune Street was revealed by Nintendo at E3 2011 for the Wii , released on... \n",
|
||
"10 Fortune Street Smart is an entry in the series developed for smartphones . I... \n",
|
||
"11 Developed by Tose and released in Japan on October 19 , 2017 }]\n"
|
||
]
|
||
}
|
||
],
|
||
"source": [
|
||
"prediction = table_qa_pipeline.run(\"When was Guilty Gear Xrd : Sign released?\", params={\"top_k\": 30})\n",
|
||
"print_answers(prediction, details=\"minimum\")"
|
||
]
|
||
},
|
||
{
|
||
"cell_type": "code",
|
||
"execution_count": 15,
|
||
"metadata": {
|
||
"id": "4CBcIjIq_uFx"
|
||
},
|
||
"outputs": [],
|
||
"source": [
|
||
"# Add 500 text passages to our document store.\n",
|
||
"\n",
|
||
"\n",
|
||
"def read_texts(filename):\n",
|
||
" processed_passages = []\n",
|
||
" with open(filename) as passages:\n",
|
||
" passages = json.load(passages)\n",
|
||
" for key, content in passages.items():\n",
|
||
" document = Document(content=content, content_type=\"text\", id=key)\n",
|
||
" processed_passages.append(document)\n",
|
||
"\n",
|
||
" return processed_passages\n",
|
||
"\n",
|
||
"\n",
|
||
"passages = read_texts(f\"{doc_dir}/texts.json\")\n",
|
||
"document_store.write_documents(passages, index=document_index)"
|
||
]
|
||
},
|
||
{
|
||
"cell_type": "code",
|
||
"execution_count": null,
|
||
"metadata": {
|
||
"id": "j1TaNF7SiKgH"
|
||
},
|
||
"outputs": [],
|
||
"source": [
|
||
"document_store.update_embeddings(retriever=retriever, update_existing_embeddings=False)"
|
||
]
|
||
},
|
||
{
|
||
"cell_type": "markdown",
|
||
"metadata": {
|
||
"id": "c2sk_uNHj0DY"
|
||
},
|
||
"source": [
|
||
"## Pipeline for QA on Combination of Text and Tables\n",
|
||
"We are using one node for retrieving both texts and tables, the `EmbeddingRetriever`. In order to do question-answering on the Documents coming from the `EmbeddingRetriever`, we need to route Documents of type `\"text\"` to a `FARMReader` (or alternatively `TransformersReader`) and Documents of type `\"table\"` to a `TableReader`.\n",
|
||
"\n",
|
||
"To achieve this, we make use of two additional nodes:\n",
|
||
"- `RouteDocuments`: Splits the List of Documents retrieved by the `EmbeddingRetriever` into two lists containing only Documents of type `\"text\"` or `\"table\"`, respectively.\n",
|
||
"- `JoinAnswers`: Takes Answers coming from two different Readers (in this case `FARMReader` and `TableReader`) and joins them to a single list of Answers."
|
||
]
|
||
},
|
||
{
|
||
"cell_type": "code",
|
||
"execution_count": null,
|
||
"metadata": {
|
||
"id": "Ej_j8Q3wlxXE"
|
||
},
|
||
"outputs": [],
|
||
"source": [
|
||
"from haystack.nodes import FARMReader, RouteDocuments, JoinAnswers\n",
|
||
"\n",
|
||
"text_reader = FARMReader(\"deepset/roberta-base-squad2\")\n",
|
||
"# In order to get meaningful scores from the TableReader, use \"deepset/tapas-large-nq-hn-reader\" or\n",
|
||
"# \"deepset/tapas-large-nq-reader\" as TableReader models. The disadvantage of these models is, however,\n",
|
||
"# that they are not capable of doing aggregations over multiple table cells.\n",
|
||
"table_reader = TableReader(\"deepset/tapas-large-nq-hn-reader\")\n",
|
||
"route_documents = RouteDocuments()\n",
|
||
"join_answers = JoinAnswers()"
|
||
]
|
||
},
|
||
{
|
||
"cell_type": "code",
|
||
"execution_count": 19,
|
||
"metadata": {
|
||
"id": "Zdq6JnF5m3aP"
|
||
},
|
||
"outputs": [],
|
||
"source": [
|
||
"text_table_qa_pipeline = Pipeline()\n",
|
||
"text_table_qa_pipeline.add_node(component=retriever, name=\"EmbeddingRetriever\", inputs=[\"Query\"])\n",
|
||
"text_table_qa_pipeline.add_node(component=route_documents, name=\"RouteDocuments\", inputs=[\"EmbeddingRetriever\"])\n",
|
||
"text_table_qa_pipeline.add_node(component=text_reader, name=\"TextReader\", inputs=[\"RouteDocuments.output_1\"])\n",
|
||
"text_table_qa_pipeline.add_node(component=table_reader, name=\"TableReader\", inputs=[\"RouteDocuments.output_2\"])\n",
|
||
"text_table_qa_pipeline.add_node(component=join_answers, name=\"JoinAnswers\", inputs=[\"TextReader\", \"TableReader\"])"
|
||
]
|
||
},
|
||
{
|
||
"cell_type": "code",
|
||
"execution_count": 18,
|
||
"metadata": {
|
||
"colab": {
|
||
"base_uri": "https://localhost:8080/",
|
||
"height": 540
|
||
},
|
||
"id": "K4vH1ZEnniut",
|
||
"outputId": "85aa17a8-227d-40e4-c8c0-5d0532faa47a"
|
||
},
|
||
"outputs": [
|
||
{
|
||
"data": {
|
||
"image/png": "iVBORw0KGgoAAAANSUhEUgAAAUkAAAILCAYAAABl8m5SAAAABmJLR0QA/wD/AP+gvaeTAAAgAElEQVR4nOzdeVxU9d4H8M+wDMOwDAgOiyzK5s4imYi4oJlWVgqmFGaY3utW2s28lS33Pj11q2uFLVi35JpLSipK5m3RzD0kN8RAQEFwQfZhGBgQhvk+f/RwrpM4og6cAb7v12tejIffnN/3HJnP/M6Zs0iIiMAYY6wtKguxK2CMMXPGIckYY0ZwSDLGmBFWYhfAegYiQlVVFSorK1FfXw+VSgUAuHbtGrRaLQBALpfDxsYGAODs7Aw7Ozu4urrCxcUFEolEtNpZz8YhyUzm4sWL+O2331BQUIDCwkIUFhaioKAAFRUVqKyshF6vv6P5WlhYwNXVFb1794a/vz/8/Pzg5+cHf39/DBkyBD4+PiZeEsb+S8LfbrM7UVlZiYMHD+Lo0aM4deoUTp06haqqKgCAUqlEv379hDBzd3eHq6sr3Nzc4OrqCgcHBygUCgCAVCqFnZ0dAKC+vh5NTU0AALVaDY1Gg8rKSpSVlaGyshKlpaVC+F64cAHl5eUAABcXF4SFhSEsLAwREREYM2YMXF1dRVgrrBtScUiydmlsbMTevXvx448/Yv/+/fjtt99gYWGBwYMHY9iwYUJIhYSEwNHRsVNqqq2txenTp4WQPnnyJLKzs6HX6zFkyBCMGzcOkyZNwoQJEyCTyTqlJtbtcEiym6uvr8euXbuwfft2fP/996irq8OwYcMwduxYjBs3DqNHj4aTk5PYZRpQq9U4ePAg9u/fj/379+PUqVOwt7fHAw88gJiYGEyZMkUYuTLWDhyS7EYnTpzA+vXrsXHjRqjVakREROCxxx7D9OnT0adPH7HLuy0VFRX4/vvvsXXrVuzevRsymQyPPvooZs+ejfvuu0/s8pj545Bkv2tpacG2bdvw7rvv4tSpUxg0aBDmzZuHWbNmoXfv3mKXZxIVFRXYsGEDkpOTkZOTg7CwMPz1r3/FY489BktLS7HLY+ZJBWI9WnNzMyUnJ1NgYCBZWlpSXFwc/fLLL2KX1eGOHDlCM2fOJEtLSwoICKA1a9ZQc3Oz2GUx81PNB5P3YLt370ZoaCgWLlyIMWPG4OzZs9i8eTNGjhwpdmkdLjIyEikpKcjNzcW4ceOwaNEihISE4McffxS7NGZmOCR7oEuXLuHhhx/GpEmTEBgYiOzsbKxZswaBgYFil9bpAgIC8MUXXyAnJwcDBgzA5MmT8fDDD+PSpUtil8bMBIdkD7N582YEBwejoKAAe/fuxY4dOxAQECB2WaLz9/dHamoqfv75ZxQUFCA4OBibNm0SuyxmBjgke4jGxkbMnj0b8fHxmDVrFk6cOIHx48eLXZbZiY6OxokTJ/Dkk09i1qxZmD17NhobG8Uui4mIv93uASorKzF16lTk5ORg06ZNmDx5stgldQk//PADnnjiCQwcOBDffPMNn8XTM/EhQN3d5cuXMW7cOBARdu3ahYEDB4pdUpeSm5uLhx56CBKJBPv374eXl5fYJbHOxSHZnVVVVWHMmDGwsLDA3r17oVQqxS6pS6qoqMCECROg0+lw8OBBHlH2LByS3dW1a9cwduxYlJeX4/Dhw/D09BS7pC6tpKQEUVFR6N27Nw4cOMDngvccfPuG7mrFihU4e/YsfvzxRw5IE/D09MTu3buRl5eHFStWiF0O60Qckt3Q3r17sWrVKnz88ccmP/Zx3759mDlzJnx8fCCTyeDg4IChQ4fihRdewOXLl03al7kJCAjAxx9/jFWrVuGnn34SuxzWWUQ72Yd1CL1eT8HBwTR16lSTz/uVV14hADRnzhw6deoUNTQ0kFqtph9++IHCw8NJoVDQ/v37Td6vuZk2bRoNHTqU9Hq92KWwjlfNIdnNbN++nSQSCWVlZZl0vjt37iQANHfu3DZ/X1tbSwEBAeTq6kpVVVUm7dvcZGdnk4WFBaWmpopdCut4fO52d/Phhx9i6tSpGDp0qEnnu3LlSgDA66+/3ubvHRwcsGzZMlRWViI5OdmkfZubQYMGYdq0aVi1apXYpbBOwCHZjahUKhw5cgSPP/64Seer1WqRnp4Ob29vo/eTiYyMBPD7hTMAYMmSJZBKpXB3dxfaLF68GHZ2dpBIJKisrBSmt7S04PXXX4ePjw9sbW0RHByMr7/+GgDwz3/+E3K5HA4ODigvL8eyZcvQp08fjB49GhKJBBKJBP7+/jh16hQAYM6cOZDL5VAoFNi5c6dJ10Wrxx9/HL/88otwywrWjYk9lmWm8/XXX5O1tTWpVCqTzvfs2bMEgMLDw422Ky0tJQDUr18/YVp8fDy5ubkZtFu5ciUBoIqKCmHaCy+8QDY2NrRt2zZSqVS0YsUKsrCwoGPHjhHRf/eHLl26lD7++GOKiYmhs2fPUmxsLFlaWtKVK1cM+njiiSdo586dd7voN6VWq8na2ppSUlI6rA9mFnhzuzvJy8uDn5+fyW+pUFdXBwDCzbtuxtnZ2aB9ezU2NmL16tWYNm0aYmNj4eTkhFdffRXW1tZYu3atQdt33nkHzzzzDFJTUzFgwAAsXLgQLS0tBu1qa2tx7NgxPPjgg7dVx+1wdHREQEAA8vLyOqwPZh44JLuR0tJSg01bU3FwcADw+/1jjGm9l/btXsk8Ly8PWq0WQ4YMEabZ2trC3d0dubm5Rl87fvx4BAUF4d///jfo/8+LSElJQVxcXIdfbdzDwwNXr17t0D6Y+DgkuxGNRiMEmin5+PjA2toaZWVlRtuVlpYK7W9HfX09AODVV18V9jFKJBIUFxdDq9Uafa1EIsGCBQtQWFiIvXv3AgDWr1+PuXPn3lYNd8LR0RG1tbUd3g8TF4dkN6JUKoV7UZuSra0tRo0ahcuXL6OoqOim7Q4fPgwAmDp16m3Nv3XkmZiYCCIyeKSnp9/y9QkJCZDJZFizZg3y8vLg6OgIX1/f26rhTpSWlsLNza3D+2Hi4pDsRjw8PHDlypUOmffLL78MAPif//mfNn9fW1uLDz74AN7e3oiLixOmW1lZobm52ei8vb29IZPJkJmZeUe1OTs7Y+bMmUhLS8N7772HP/3pT3c0n9t15cqVDtm9wcwLh2Q3Mnz4cFy5cgXnzp0z+bzvv/9+/OMf/8C6deuQkJCA06dPo7GxEbW1tdi9ezeio6NRV1eHtLQ0gy94AgICUF1djbS0NDQ3N6OiogLFxcUG85bJZJgzZw42b96M1atXo7a2Fi0tLbh8+XK79/ktXLgQ165dw65du/Dwww+bdNnbUlhYiEuXLmHEiBEd3hcTmahfrjOTam5uJmdnZ1q1alWH9ZGenk5PPPEE+fj4kFQqJYlEQgDIy8uLqqurb2hfVVVF0dHRJJPJqF+/fvTss8/S8uXLCQAFBATQxYsXiYjo2rVr9OKLL5KPjw9ZWVlR7969KTY2lrKzs+ndd98lW1tbAkDe3t60YcOGNmsLCwujl19+ucOW/XoffvghOTk5UVNTU6f0x0RTzZdK62aefvppZGRk4MyZM7Cw6PgNhaqqKoSHh6O4uBj/+Mc/hM1yMTz00EP45JNP0K9fvw7tR6/XIzg4GOHh4Vi3bl2H9sVEx5dK625efvll5OXlYdu2bZ3Sn4uLC9LS0uDo6IhXXnkFb731FrRaLTrjs/f6fZ1ZWVmQyWQdHpAAsG3bNpw9exbLly/v8L6YGRB5KMs6wBNPPEH+/v6k0Wg6rc+TJ09SZGQk2djYkI+PD+3evbvD+/zLX/5C+fn5lJeXR8OGDaPs7OwO71Oj0ZC/vz89/vjjHd4XMwvVVmKHNDO9xMREBAcH47nnnsOaNWs6pc+wsDAcOXKkU/pqJZfLMWDAAPTp0wdJSUkYNGhQh/f5l7/8BWq1Gu+//36H98XMA++T7KbS0tIQExODf//730hISBC7nG5h/fr1SEhIQGpqKqZNmyZ2Oaxz8D7J7mrq1KlYsWIF/vSnP3XYlXB6kp07d2Lu3Ll46aWXOCB7GB5JdnMLFy7El19+iZSUFDz66KNil9MlffPNN4iLi8NTTz2FTz/9FBKJROySWOfhkWR3l5SUhISEBMTGxvJFYu/Ahx9+iNjYWDz11FNISkrigOyB+Iubbs7CwgKffvop/P39sWzZMpw+fRofffRRh1wIozvRaDRYunQp1q1bh3fffRcvvPCC2CUxkfDmdg+ya9cuzJ07F3Z2dtiwYQNGjRoldklm6ciRI5g9ezY0Gg3+/e9/Y8qUKWKXxMTDm9s9yZQpU3DmzBkEBwdjzJgxmD179i0vf9aTVFVVYenSpRg7diwCAwORmZnJAcn4Ahc9jVKpRFpaGjZs2IB9+/ahf//+WLly5S2v29idNTQ04P3334e/vz+2b9+OdevW4YcffoCnp6fYpTEzwJvbPZhWq8W7776L9957D/b29li6dCkWL158y9s0dBdqtRqrV6/GqlWrUFdXh2XLluHFF1+EnZ2d2KUx86HikGQoLy/Hhx9+iKSkJBARnnrqKcybNw/BwcFil9YhsrKykJycLFycYtGiRXjuueegVCpFroyZIQ5J9l9qtRr/+te/8MUXX+D8+fMYPnw45syZg5iYmC5/Be6ysjLs2LEDa9euxa+//orAwEDMmzcP8+fP7zEjZ3ZHOCTZjYgIBw4cQHJyMrZv347GxkaMHDkS06ZNw5QpU9C/f3+xS2yXvLw87Nq1Czt27EB6ejpkMhliYmIwd+5cjB07lo95ZO3BIcmM02q12L17N3bs2IFdu3ahuroanp6eiI6OxtixYxEVFYWgoKAOvzPhrej1euTn5+Pw4cPYv38/9u3bh5KSEvTq1QtTpkzBtGnTcP/990Mul4taJ+tyOCRZ++l0Ohw7dgz79u3D/v37ceTIEWi1WtjZ2SE4OBhhYWEICQmBv78//Pz84O3tDSsr056voNPpcOnSJRQWFqKgoACnT59GZmYmTp8+jfr6esjlcowaNQrjxo1DdHQ0hg8fbvIaWI/CIcnuXFNTE86cOYNTp04hMzMTmZmZOHPmjHCbVWtra/j4+MDDwwOurq5wdXWFUqmEo6MjHBwcYGVlBUtLSzg6OgKAcG8bnU4HjUaD2tpalJeXo7KyEpWVlSgtLUVxcbFwsV1HR0cMHToUoaGhCA0NRVhYGIYOHQqpVCraOmHdDockM73KykoUFBQIo73rg668vBwajQb19fVoamoSAhGAEJxSqRR2dnZwcHCAUqk0CNjWUaq/vz9cXV1FXlLWA3BIMvHFxcVBp9N12i0nGLsNfFoiY4wZwyHJGGNGcEgyxpgRHJKMMWYEhyRjjBnBIckYY0ZwSDLGmBEckowxZgSHJGOMGcEhyRhjRnBIMsaYERySjDFmBIckY4wZwSHJGGNGcEgyxpgRHJKMMWYEhyRjjBnBIckYY0ZwSDLGmBEckowxZgSHJGOMGcEhyRhjRnBIMsaYERySjDFmBIckYyLT6/VITExEZGSk2KWwNnBIMiaic+fOYcyYMXj++eeh1WrFLoe1gUOSdVsNDQ0dPjq7mz5Onz6Nl156CQsXLkRoaKiJK2OmwiHJuq3k5GSUl5ebbR8hISFITU1FfHw8bGxsTFwZMxUOSWY2iAgffPABBg4cCBsbGzg7O2Pq1KnIzc0V2ixZsgRSqRTu7u7CtMWLF8POzg4SiQSVlZUAgOeeew7Lli1DQUEBJBIJAgIC8NFHH0Emk0GpVGLBggXw8PCATCZDZGQkMjIyTNIH64aIMZHNnDmTYmNj6fXXXyepVEobNmygmpoaysrKomHDhpGrqyuVlpYK7ePj48nNzc1gHitXriQAVFFRIUyLjY0lf39/g3bz588nOzs7ysnJocbGRsrOzqbhw4eTg4MDXbx40SR93IkRI0ZQSEjIXc+HmVw1jySZWWhpacEHH3yAmJgYzJo1CwqFAkOHDsVnn32GyspKfP755ybry8rKShitDho0CKtXr4ZGo8HatWtN1gfrPjgkmVmora1FXV0d7rnnHoPpw4cPh1QqNdgcNrV77rkHcrncYLOesVYckswsNDc3AwDs7e1v+J2TkxM0Gk2H9m9jY4OKiooO7YN1TRySzCxYW1sDQJthWFNTAy8vrw7ru7m5ucP7YF0XhyQzC46OjrC3t8fx48cNpmdkZKCpqQnh4eHCNCsrK2HkaQr79+8HESEiIqLD+mBdF4ckMwuWlpZYtmwZtm/fjo0bN6K2thZnzpzBwoUL4eHhgfnz5wttAwICUF1djbS0NDQ3N6OiogLFxcU3zLNXr14oKSlBUVERNBqNEHp6vR4qlQo6nQ5ZWVl47rnn4OPjg4SEBJP1wboRsb9fZ6z1ECC9Xk8rV66kwMBAsra2JmdnZ5o2bRrl5eUZtK+qqqLo6GiSyWTUr18/evbZZ2n58uUEgAICAoRDeU6ePEm+vr5ka2tLUVFRVFpaSvPnzydra2vq06cPWVlZkaOjI02dOpUKCgpM1kd7paen06hRo8jDw4MAEAByd3enyMhIOnDgwF2uVWYi1RIiInFjmvV0cXFx0Ol02LZtW4f3tWDBAmzduhVVVVUd3hfrFlS8uc16nJaWFrFLYF0IhyRjJpKbmwuJRHLLR1xcnNilstvAIcl6jBUrVmDt2rVQq9Xo16+fyTfvBwwYACK65SMlJcWk/bKOxfskmeg6c58kY7eJ90kyxpgxHJKMMWYEhyRjjBnBIckYY0ZwSDLGmBEckowxZgSHJGOMGcEhyRhjRnBIMsaYERySjDFmBJ+WyDrV9u3bbzh3+cyZMyAiBAcHG0yfMWMGpk+f3pnlMfZHKg5J1qkyMzMRFhbWrrbHjx83uG0DYyLgkGSdLygoCOfOnTPaxtfXF0VFRZ1TEGM3xxe4YJ3vySefFO6O2BapVIo5c+Z0YkWM3RyPJFmnKygoQGBgIIz96eXm5qJ///6dWBVjbeKRJOt8/v7+CA0NhUQiueF3EokEwcHBHJDMbHBIMlHMnj0blpaWN0y3srLC7NmzRaiIsbbx5jYTxdWrV+Hl5QW9Xm8wXSKR4OLFi/Dy8hKpMsYM8OY2E4eHhwdGjx5tMJq0sLBAZGQkByQzKxySTDRPPvmkwb8lEglvajOzw5vbTDQ1NTVQKpVobm4GAFhaWqKsrAwuLi4iV8aYgDe3mXicnJwwefJkWFlZwdLSEpMmTeKAZGaHQ5KJKj4+Hi0tLSAixMfHi10OYzewErsA1nUREWpqagAAarUaer0eGo0GOp0OAKDVanHt2rU2X1tXV4fm5ma0tLRAKpVCr9ejpaUFW7duhbW1Nezt7dt8nY2NDeRyOYDfDxdycHCARCKBk5MTgN9Hp20df8nYneJ9kj1IS0sLqqqqhIdarUZdXR3UarXwvK6uDhqNBjU1NdBoNNBoNMK0pqYm1NfXQ6fTQaPRiL04Rjk4OMDKygp2dnaQSqVwcHCAvb09HBwc4ODgACcnJ2Gavb09FAoFFAqF8NzFxUV4tHU8J+sx+AIXXVlzczPKy8tRUlKC0tJSXL16FeXl5QZBWFVVherqalRUVAijvutZWFhAoVDA0dFRCBF7e3s4OzsLAdIaHMZGbn8MJQDtHhF+9913aGlpwcMPPwygfSNQADeE9vUj25qaGhCRMLK9/kOgrq4OKpVKCP+6ujrU1tYKo+E/cnJygqurq0Fwtj6USiU8PDzg7u4OT09PKJVKo+elsy6HQ9Jc1dXVoaioSHhcvXoVV65cQXl5OS5fvozy8nKUl5cbnP/s6OgId3f3Nt/Mrq6uwhu9V69ecHFxgZOTkxBUYmpubgYRCeEqJq1Wi5qaGlRXVwsfMpWVlaisrGzzw6e0tBRqtVp4vUQigVKphFKphJeXF5RKJfr06QMPDw/07dtXeNzsw4OZHQ5JsVy7dg3nz59HYWEhLly4gOLiYhQVFQk/q6qqhLaurq7w8PAweNO5ubnB09PTYBRja2sr4hL1XA0NDbh69arBo7S01OBD7erVq6isrBRe4+Ligr59+8LX11f42a9fP/j5+SEgIAA2NjYiLhG7DodkR1OpVCgsLER2djZycnKE53l5eWhpaQEAODs7w8/PDx4eHvD09ISfn5/wCAgIgEKhEHkpmCk0NjaipKQEhYWFwqOkpARXr15FYWEhioqKhM19Dw8PDB48GH5+fhg0aJDwvG/fvrCw4INSOhGHpKnU1tYiKysLp0+fxunTp5GZmYnc3FzhCw4nJycEBQWhf//+6N+/v/A8ICDALDZ5mfgaGhpw7tw55OfnIy8vT3jk5+cL+1odHBwwYMAAhIaGIiQkBCEhIQgODoajo6PI1XdbHJJ3ory8HBkZGcjMzBQCsbCwEEQEZ2dn4Y93yJAhCAoKwoABA6BUKsUum3Vh5eXlyM3NRX5+Pn777Tfhw1ilUkEikcDPz08IztDQUIwYMYL/5kyDQ/JWWlpakJubixMnTuDIkSM4fPgwzp49CyKCh4cHwsPDER4ejsGDB2PQoEEYNGgQH6fHOk1JSQlycnKQnZ2NEydO4MSJE8jNzYVer4eHhweioqIwatQohIeH49577zWLL8e6GA7JP9LpdEhPT8eePXtw6NAhHDt2DPX19VAoFBgxYgRGjhyJiIgIjBw5kvcVMrOkVquRnp6Oo0ePIj09HRkZGVCr1bCzs8Pw4cMxevRoTJw4ESNHjoSVFZ9PcgsckgBw7tw57N69G3v27MHPP/8MjUaDfv36Ydy4cRg5ciRGjhyJQYMG8Q5z1iXp9Xrk5OQgPT0d6enp2LdvH4qKiuDg4IDx48dj4sSJuP/++xEYGCh2qeaoZ4akXq/HkSNHsHXrVuzatQsXLlyAo6MjoqOjcf/992PixIn8B8O6tXPnzmHPnj3CwKC2thZ9+/bFww8/jMceewyjRo3iQcHvek5I6vV6/PLLL9i6dSu2bduGkpISDB48GDExMZg0aRJGjBjBmx6sR9LpdMjIyMCPP/6I7du3Izs7G56enpg+fToee+wxREZG9uTA7P4heenSJXz66adYv349rly5gkGDBuGxxx7DjBkzMGjQILHLY8zs5OTkYOvWrdiyZQtycnLQp08fzJ49GwsXLoS3t7fY5XW27huS+/btQ1JSEr755hv07t0bc+fORVxcHAYPHix2aYx1GdnZ2UhJSUFycjIqKirwyCOP4JlnnkF0dLTYpXUWFagb0ev1lJKSQkOGDCEAFBkZSZs2baJr166JXRpjXdq1a9do8+bNNGrUKAJAgwcPps2bN5Nerxe7tI5W3W12NBw+fBgjR47EE088gdDQUOG4xscff5yPDWPsLkmlUsTFxeHw4cM4efIkhg0bhvj4eERERODQoUNil9ehunxIXrx4EbGxsRg9ejQcHBxw4sQJbNiwAcOGDevUOlJTU+Hn5weJRHLTR9++fU3S1/Dhw2FpaYnQ0FCTzO968+bNEy6HlpmZedvtvvvuOygUCnz77bcmrw24+XqWyWTo168fnn76aVy4cKFD+m7V0cto7sLCwrB+/XqcPHkSCoUCY8aMQUxMDC5evCh2aR1D7LHs3diyZQs5OTnRgAED6LvvvhO7HCIi8vf3J4VCIfxbp9ORVqulsrIyGjhwoMn6mTBhAoWEhJhsftfbvHkzAaBTp07ddrtdu3aRo6Mj7dy5s0Nqa3X9em5paaGysjJav349yeVyUiqVVFlZ2WF9d9YydhXff/89DRw4kJycnGjLli1il2NqXXdz+80338TMmTMRHx+PkydP4oEHHhC7pDZZWlrC1tYWSqUSQUFBJp23OZ7++NBDD0GtVgsX0O0MFhYWUCqVePLJJ/HMM8+gvLwcP/30023No6GhAZGRke1qK8YymrPJkyfjxIkTiI+Px8yZM/G///u/YpdkUl3ywMA33ngDb7zxBlavXo0FCxaIXU67paWlmXR+HXUF7PaGb2eENBFh27ZtUKlU+POf/3zL9gEBAQCA0tLS2+onOTkZ5eXld1QjA2xtbfHJJ59g6NChWLx4MVpaWvD3v/9d7LJMQ+yx7O1KS0sjiURC//rXv8QupU1/3Ny+mcTERJLL5SSRSGjYsGGkVCrJysqK5HI5hYWFUVRUFHl5eZGNjQ0pFApavny5wesnTJhAzs7O1L9/f5LL5SSTySgqKooOHTpk0E6n09Frr71G3t7eJJPJaOjQoZSSkiL8Xq/X0z//+U8KCgoiqVRKjo6O5O3tfcNmdHvaHTp0SJj28ccfExFRUlISyeVysrW1pbS0NJo8eTI5ODhQnz59aNOmTTfU+tZbb1FQUBDJZDJycXEhX19fCg0NJZVK1a71vHz5cgJA+/bta/d6WLp0KUmlUgJAAMjf35/effddsrW1JXt7eyorK6Pnn3+ePD09ac2aNTcs463mP2DAAAIg/F/X19cLtTo6OpKNjQ2tXbv2lvO5WU25ubk3rAcxff755ySRSGjHjh1il2IK1V0qJBsbG8nLy4sSEhLELuWm2nrzLl26lM6cOXND27/97W8EgDIyMqi+vp4qKytp8uTJBID+85//UEVFBdXX19OSJUsIAGVmZgqvnTBhAvn5+dGFCxeoubmZfvvtNxoxYgTJZDLKz88X2r3wwgtkY2ND27ZtI5VKRStWrCALCws6duwYERG98sorJJFI6P333yeVSkVarZaSkpJuCMn2trt06dINAfLKK68QANq7dy+p1WoqLy+n0aNHk52dHTU1NQnt3nrrLbK0tKRvvvmGtFotnThxgtzc3GjcuHG3XM8qlYq+/PJLksvl9NBDD93Q/lbrITY2lvz9/Q1e01r30qVL6eOPP6aYmBg6e/Zsm8tobP46nY769u1LPj4+pNPpDPr4y1/+QomJibf1/9VWTeYmISGBvLy8qKGhQexS7lbXCsmtW7eSlZUVXblyRexSbsrf318YkVz/MBaSGo1GmLZu3bob2v/6668EwGAE2NYXN1lZWQSAXnjhBSIiamhoILlcTnFxcUIbrVZLNjY2tGjRItJqtSSXy2nixIkG8/njFzLtbUdkPCSvf8O0Buz58+eFacOHD6d776xPV74AACAASURBVL3XoI8///nPZGFhccOxrm2tZ4lEQm+++aZB8LZnPRAZD8k/vtH/uIztmX9iYiIBMPhio76+nnx8fEitVrd7PjerydyUlJSQlZUVff3112KXcre61hc3R44cwT333ANPT0+xSzFKoVCAiITH0qVL2/3a1mM6W+9dDfx332PrXQJvZujQoVAoFMjKygIA5OXlQavVYsiQIUIbW1tbuLu7Izc3F+fPn4dWq8WECROMzre97W5H63Jev0yNjY0GNzYDfr+ep7W1dZu3db1+PS9fvhxEBIVCccO+2luth7vVnvnPmzcPCoUCq1atEtps3LgRU6dOFa4q3tF1diYPDw/ce++9OHz4sNil3LUuFZIqlQq9evUSu4zbtmrVKoM//I5kbW0tBE99fT0A4NVXXzU4prC4uBharRaXL18GAPTu3dvoPNvb7m49+OCDOHHiBL755hs0NDTg+PHjSEtLw5QpU2557+vXXnsN7u7uWLFiBS5dumTwu1uth7vVnvnb29vjz3/+M3755Rf8+uuvAIBPP/0US5Ys6bQ6O5urqytUKpXYZdy1LhWSPj4+yM/PF7sMs6XT6VBdXQ0fHx8A/w21xMREg5EtESE9PR0ymQwAbnqP61btbXe3/v73v2P8+PFISEiAo6MjYmJiMGPGDHzxxRe3fK2DgwPeeecdaDQaLFq0yOB3t1oPd6u981+yZAmsra2RmJiIgwcPwtvbG/7+/p1WZ2fLzc2Fr6+v2GXctS4Vko8++ijOnz+PAwcOiF3KHbl69SrmzJnTYfPft28f9Hq9cLaRt7c3ZDLZTc+cGTJkCCwsLG65Ptvb7m5lZ2ejoKAAFRUVaG5uxsWLF7F69Wo4Ozu36/WzZ8/GiBEjsGvXLmzZskWYfqv1cLfaO38vLy/MmDED27Ztw2uvvYbnnnvujubTFRw6dAj5+fl49NFHxS7lrnWpkAwPD8ekSZPwzDPPdKnNDyJCQ0MDUlNTTXpXu6amJqjVauh0Opw8eRJLliyBr68vEhISAPw+ApwzZw42b96M1atXo7a2Fi0tLcJ9oHv37o3Y2Fhs27YNycnJwh0fP//8c4N+2tvubj3zzDPw8fFBXV3dHb1eIpHgo48+gkQiwZIlS4RNvVutBwDo1asXSkpKUFRUBI1Gc8v9v9drz/xbLVu2DDqdDiqVCuPHj7/j+ZgzrVaLRYsW4f7778fw4cPFLufudd6XRKZRWFhIrq6u9Mgjj5jV1X22b99+02+2r3+8+uqrRES0atUqksvlBID69u1Lhw4donfeeYcUCgUBIDc3N/rqq68oJSWF3NzcCAA5OzvT5s2biYho7dq1FB0dLRxf6eLiQo8//jgVFxcb1HXt2jV68cUXycfHh6ysrKh3794UGxtL2dnZRESk0Who3rx55OLiQvb29hQVFUWvv/46ASAvLy86ffp0u9t9/PHH5O7uTgBILpfTI488IhwnCYACAwOpoKCAPv/8c3J0dCQA5OvrKxyy9PPPP5OLi4vB+rK2tqaBAwdSamoqEREdOXKEgoKChN97enrSggULDJY5ISGBAJCTkxO9/fbb7VoPJ0+eJF9fX7K1taWoqCh6/vnnydbWlgCQt7c3bdiwgYiozWVsz/yvFx0dTWvWrGnz78jYfFqPk/xjTeakqamJHn30UXJ1daXCwkKxyzGF6i55Pcn09HThauLbtm3jG3J1E6tXr8a5c+eQmJgoTGtqasJLL72E1atXQ6VSwdbWVsQKmTFqtRqPPfYYjh49ih9++KHdp3maOVWX2txuNXLkSBw4cAA5OTkIDQ3tFocZ9HSlpaVYsmQJ5s6dazBdKpXCx8cHzc3Nt7UJzDrX4cOHERoaiuzsbBw4cKC7BCSALrZP8nphYWHIzMxEcHAwxowZgxkzZnT4JbJYx7G1tYW1tTWSk5NRVlaG5uZmlJSUYM2aNXj99dcRFxdn0v25zDSuXLmC+fPnY9y4cQgKCsLx48cRFhYmdlmmJfYGvyns3LmTAgICSCqV0pIlS6impkbsktgdOHjwIN13333k6OhIlpaWpFAoKDIykpKSkqi5uVns8th16urq6J133iF7e3vy8fGhdevWdderlHfNfZJtaWpqQlJSEt58801IJBLMnTsXCxcuNNmFbhljQFFRET777DOsWbMGer0er776Kp555pnufPX/7ncjsOrqaqxevRqfffYZSktL8dBDD+GZZ57BfffdZ5bXX2TM3BERfvrpJyQlJWHXrl1wc3PDggULsHjx4i55Btxt6n4h2Uqn02HHjh1ISkrCgQMHEBAQgJkzZ2LGjBkIDg4WuzzGzF5WVha2bt2KlJQUnD9/HmPHjsXixYsxderUDruWqRnqviF5vTNnzmDt2rXYtm0bLl26hP79+2PGjBmYMWNGp51TzVhX8Ntvv2HLli3YunUrcnNz4e3tjenTp2POnDkYOnSo2OWJoWeEZCsiwtGjR7Flyxakpqbi0qVLCAwMxKRJkzBx4kRER0fDwcFB7DIZ6zQajQb79u3Dnj17sHv3buTn58Pb2xuxsbGYMWMGIiIievpuqp4Vktej/79owLfffos9e/bg1KlTsLCwwMiRIzFx4kRMnDhRuCshY91FS0sLjh07hj179mDPnj1IT0+HXq9HWFgYJk6ciIcffhgjR47s6cF4vZ4bkn9UWVmJffv24aeffsIPP/yAixcvws7ODqGhoQgPD0dUVBTGjRvX4ZcLY8yUamtr8euvv+Lw4cM4ceIEDh8+jJqaGri5uWHMmDG47777MGXKFLO/RquIOCRvJicnB4cOHUJ6ejqOHj2KvLw8SCQS9O/fHxERERg5ciSGDRuGIUOGCJcSY0xMjY2NyM7OxsmTJ5Geno709HTk5eWBiIS/28jISERFRWHQoEFil9tVcEi2V1VVlRCYv/zyC44dO4a6ujpYWVkhKCgIISEhCAkJQWhoKEJCQuDu7i52yawbKy0txenTp5GZmYnTp08jKysLeXl50Ol0sLe3xz333INRo0YhIiICERERcHV1FbvkropD8k7p9XqcP3/+hj/U1qtiu7m5YfDgwejfv7/wCAoKgq+vL+/nZO2i1+tRVFSE/Px85OXlCY/s7GyUlZUB+P0alX/8gA4ICICFRZc949jccEiaWnV1tRCaZ8+eRV5eHnJzc4V7OtvY2CAwMFAIzcDAQPj6+sLX1xfe3t7d+cwF1oampiZcunQJxcXFKC4uxrlz54RQPHfunHA1eKVSiQEDBqB///4YOHCgEIo94GBusXFIdpaamhrk5+cjNzcXeXl5yM/PR35+vnCTLQCwsLCAh4cH+vbti759+8LX11f42adPH3h4ePCboouprq7G1atXceXKFRQXF6OoqMjgZ0lJCfR6PYDfL/IRGBiIoKAgBAUFoX///hgwYACCgoLg5OQk8pL0WByS5qC8vFwYSVz/Jmp9rtFohLYymQzu7u7w9PSEu7s7+vTpAzc3N+Gnh4cHXFxc0KtXL9jZ2Ym4VN2XVqtFVVUVqqqqcPXqVZSVleHKlSvCz9LSUpSUlKC0tBSNjY3C6xwcHIQPvj9+CPr6+kKpVIq4VOwmOCS7gurqapSUlAhvvJKSEly9elV4tE774y0tZDIZXFxchNB0cXFB7969heeOjo5QKBRQKBSwt7eHvb09HBwc4OTkBAcHB1hZWYm0xB1Lp9NBo9GgpqYGGo0GdXV1qKurg1qthlqtRm1tLaqqqlBdXY2KigrheWswXh98wO8jQE9PT3h4eBg8Wj/IPD094enpyVsBXROHZHdSW1uL0tJSgzf09c+rqqpQWVkpTK+trYVarb7p/GQyGezt7eHo6AgnJydIJBIoFApYWFgIISqXy2FjYwOZTCZcE9Le3l6Yh42NDeRyeZvzb53n9YgINTU1bbbXarUGd2ysq6tDc3MzGhoa0NjYiGvXrkGr1QohqNfroVarhXnW1tairq7uhpC7nkKhgIODg/Dh4urqKjy//sOm9bm7uztf57J745Bkv192v66uThhVXR8ordNUKpVBgKnVauj1eiGoWgOsNaha1dfXo6mp6YY+W4OsLTcbxUqlUoNdCK0B3RrErQFtYWEh3NKjNYhbR8cODg4Gwd86era3t+fbgLC2cEgy8cXFxUGn02Hbtm1il8LYH3XNe9wwxlhn4ZBkjDEjOCQZY8wIDknGGDOCQ5IxxozgkGSMMSM4JBljzAgOScYYM4JDkjHGjOCQZIwxIzgkGWPMCA5JxhgzgkOSMcaM4JBkjDEjOCQZY8wIDknGGDOCQ5IxxozgkGSMMSM4JBljzAgOScYYM4JDkjHGjOCQZIwxIzgkGWPMCA5JxhgzgkOSMZHp9XokJiYiMjJS7FJYGzgkGRPRuXPnMGbMGDz//PPQarVil8PawCHJuq2GhoYOH53dTR+nT5/GSy+9hIULFyI0NNTElTFT4ZBk3VZycjLKy8vNto+QkBCkpqYiPj4eNjY2Jq6MmQqHJDMbRIQPPvgAAwcOhI2NDZydnTF16lTk5uYKbZYsWQKpVAp3d3dh2uLFi2FnZweJRILKykoAwHPPPYdly5ahoKAAEokEAQEB+OijjyCTyaBUKrFgwQJ4eHhAJpMhMjISGRkZJumDdUPEmMhmzpxJsbGx9Prrr5NUKqUNGzZQTU0NZWVl0bBhw8jV1ZVKS0uF9vHx8eTm5mYwj5UrVxIAqqioEKbFxsaSv7+/Qbv58+eTnZ0d5eTkUGNjI2VnZ9Pw4cPJwcGBLl68aJI+7sSIESMoJCTkrufDTK6aR5LMLLS0tOCDDz5ATEwMZs2aBYVCgaFDh+Kzzz5DZWUlPv/8c5P1ZWVlJYxWBw0ahNWrV0Oj0WDt2rUm64N1HxySzCzU1tairq4O99xzj8H04cOHQyqVGmwOm9o999wDuVxusFnPWCsOSWYWmpubAQD29vY3/M7JyQkajaZD+7exsUFFRUWH9sG6Jg5JZhasra0BoM0wrKmpgZeXV4f13dzc3OF9sK6LQ5KZBUdHR9jb2+P48eMG0zMyMtDU1ITw8HBhmpWVlTDyNIX9+/eDiBAREdFhfbCui0OSmQVLS0ssW7YM27dvx8aNG1FbW4szZ85g4cKF8PDwwPz584W2AQEBqK6uRlpaGpqbm1FRUYHi4uIb5tmrVy+UlJSgqKgIGo1GCD29Xg+VSgWdToesrCw899xz8PHxQUJCgsn6YN2I2N+vM9Z6CJBer6eVK1dSYGAgWVtbk7OzM02bNo3y8vIM2ldVVVF0dDTJZDLq168fPfvss7R8+XICQAEBAcKhPCdPniRfX1+ytbWlqKgoKi0tpfnz55O1tTX16dOHrKysyNHRkaZOnUoFBQUm66O90tPTadSoUeTh4UEACAC5u7tTZGQkHThw4C7XKjORagkRkbgxzXq6uLg46HQ6bNu2rcP7WrBgAbZu3YqqqqoO74t1Cyre3GY9TktLi9glsC6EQ5IxE8nNzYVEIrnlIy4uTuxS2W3gkGQ9xooVK7B27Vqo1Wr069fP5Jv3AwYMABHd8pGSkmLSflnH4n2STHSduU+SsdvE+yQZY8wYDknGGDOCQ5IxxozgkGSMMSM4JBljzAgOScYYM4JDkjHGjOCQZIwxIzgkGWPMCA5Jxhgzgk9LZJ1q+/btN5y7fObMGRARgoODDabPmDED06dP78zyGPsjFYck61SZmZkICwtrV9vjx48b3LaBMRFwSLLOFxQUhHPnzhlt4+vri6Kios4piLGb4wtcsM735JNPCndHbItUKsWcOXM6sSLGbo5HkqzTFRQUIDAwEMb+9HJzc9G/f/9OrIqxNvFIknU+f39/hIaGQiKR3PA7iUSC4OBgDkhmNjgkmShmz54NS0vLG6ZbWVlh9uzZIlTEWNt4c5uJ4urVq/Dy8oJerzeYLpFIcPHiRXh5eYlUGWMGeHObicPDwwOjR482GE1aWFggMjKSA5KZFQ5JJponn3zS4N8SiYQ3tZnZ4c1tJpqamhoolUo0NzcDACwtLVFWVgYXFxeRK2NMwJvbTDxOTk6YPHkyrKysYGlpiUmTJnFAMrPDIclEFR8fj5aWFhAR4uPjxS6HsRtYiV0A6x6amppQX1+PhoYGNDY2oq6uTtiMVqlUN7RvaWlBbW0tWlpaIJVKodfr0dLSgq1bt8LR0bHNw4OcnJwgkUhgbW0Ne3t7yGQy2Nraws7ODlKptMOXkfVMvE+SQavVory8HKWlpaiurkZNTQ3UajXUajVqamqgUqmE563Tr127BpVKJYSdOWgNV2dnZ9jY2EChUEChUMDJyQkKhQLOzs7C89bpvXr1gru7O5RKJeRyudiLwMwPX+CiO6usrMSlS5dw+fJlFBcXC0FYVlaGiooKlJWVoaysDPX19Qavs7KyEsLEyckJzs7OBmHj5OQEGxsbODk5wdLSEo6OjpBKpbCzs2tzdOfg4AArqxs3WlpHht999x1aWlrw8MMPg4hQU1NzQ1udTgeNRgPgv6PWxsZGNDQ0oL6+Hk1NTdBoNNDpdKipqcG1a9eEUG/9qVKpDKbpdDqDPuzs7ODm5gY3Nzf07t0bbm5uQoD6+vrCy8sL3t7ecHV1NdV/ETN/HJJdWXl5OfLz83Hu3DkUFRXh4sWLQihevHgRDQ0NQltXV1e4u7sLb/zevXtDqVQaPPfw8ECvXr1gZ2fXqcvR3NwMIur0Teb6+npUV1fj6tWrKC8vR0VFBUpLSw2el5WVobS0FJWVlcLrbG1t4ePjA29vb3h5ecHX1xe+vr4IDAxEUFAQlEplpy4H61Ackuauvr4eOTk5yM/PFwKx9aFWqwH8/qb18/MT3rTe3t7CyMfLyws+Pj6wtbUVeUm6toaGBly8eBGXL18WRubXfyBduHBB+FBSKBQICAhAYGCgEJxBQUEYPHhwp38AsbvGIWlOSkpKcOLECeTk5CA7OxsnTpxAXl4eWlpaYG1tDW9vb/j5+cHPzw+DBg3C4MGD4efnh759+8LCgg9UEJtKpUJhYSGys7ORk5ODwsJCFBYW4uzZs9BqtQB+P9MoPDwcgwcPxqBBgxAeHo4BAwa0+UUVMwsckmIpLi7G0aNHkZGRgYyMDJw+fRr19fWwtLSEv78/goODMXToUAwdOhTBwcHo27cvv5G6qJaWFly4cAFZWVk4c+YMzpw5g6ysLBQUFECv18POzg4hISEYMWIERowYgYiICPj6+opdNvsdh2RnaGpqwtGjR/HLL78IwVhaWgorKysEBwcjIiICw4YNQ0hICAYNGsTfsvYQWq0W2dnZyMrKwsmTJ3H06FFkZWVBp9PB3d1dCMzIyEhERETwYU7i4JDsCHq9HmfPnsWRI0fw008/4ccff0Rtba2wqRUeHo6oqChERkZyIDIDzc3NyMrKwuHDh3HixAkcOXIEhYWFsLW1xahRo3Dfffdh1KhRGDFihNGruzOT4ZA0laqqKuzcuRO7du3C/v37UV1dDaVSifHjx2PChAkYP348/Pz8xC6TdUEXLlzA3r17sXfvXvz8888oLy9Hr169MG7cOEyZMgWPPPIIn87ZcTgk78aVK1eQlpaG7du34+DBg7CyssL48eMxceJETJgwAUOGDGnz6tuM3Skiwm+//Ya9e/diz549+Pnnn6HT6TB27FhMmzYNU6dORZ8+fcQuszvhkLxdtbW12Lx5M7788ktkZGTA3t4eDz74IGJiYvDAAw/AwcFB7BJZD6LRaPD9998jNTUV33//Perq6hAREYGnnnoKjz/+OBwdHcUusavjkGyvX375BWvWrMGWLVug1+sxffp0zJgxA/fddx9kMpnY5TGGxsZG/PTTT/j666+RmpoKCwsLzJgxA/PmzUNkZKTY5XVVHJLG6HQ6bNq0Cf/85z+RnZ2N0NBQzJs3D/Hx8XBychK7PMZuqqamBl999RXWrFmDzMxMDB48GH/961/xxBNPtHmKKLspDsm26HQ6bNy4EW+99RaKioowa9YsLF68GPfcc4/YpTF2244fP46kpCRs3LgRffv2xSuvvIJZs2ZxWLaPCsQMpKamkp+fH1lbW9PTTz9NBQUFYpfEmEkUFBTQ008/TdbW1uTn50epqalil9QVVPO5bP+vtLQU06dPx/Tp0xEVFYW8vDwkJyfzYTus2/Dz80NycjLy8vIQFRUl/L2XlpaKXZpZ45AEsGnTJgwePBgnT57Ejz/+iHXr1qFfv34d3m9qair8/PwgkUgMHjKZDP369cPTTz+NCxcudHgdt+tmdUulUiiVSowbNw4rV65s82K7THz9+vXDunXrsHv3bpw8eRKDBw/Gpk2bxC7LfIk9lhVTS0sLvfDCCySRSOjZZ5+luro6Uerw9/cnhUIh1FRWVkbr168nuVxOSqWSKisrRanrVq6vW6/Xk0qlon379lFCQgJJJBLy8PCgY8eOiVwlM6auro6WLFlCEomEli9fTnq9XuySzE11jw1JvV5PCxcuJBsbG9q4caOotVwfNtf761//SgAoJSWlQ/vXarU0cuTI237dzeomItq6dStZWFiQUqmkmpqauy2xS7vT9duZNmzYQDY2NrRo0SIOSkM9d5/ke++9hy+++AIpKSlmewOqgIAAAOjwfUbJyckoLy836TynT5+OhIQElJeX47PPPjPpvLuajli/pjZr1iykpKTgiy++wPvvvy92OeZF7JgWQ1ZWFllbW9PKlSvFLoWIbj4iW758OQGgffv2GUzX6/X0/vvv04ABA0gqlZKTkxM9+uijdPbsWaHNs88+S9bW1uTm5iZMW7RoEcnlcgJAFRUVRES0dOlSkkqlBIAAkL+/PxER6XQ6eu2118jb25tkMhkNHTr0hhGtsZEkEdHBgwcJAI0dO/a2am+1fv16Cg8PJxsbG5LL5eTr60tvvPFGu5ctMTGR5HI5SSQSGjZsGCmVSrKysiK5XE5hYWEUFRVFXl5eZGNjQwqFgpYvX27Qv7F1kJSURHK5nGxtbSktLY0mT55MDg4O1KdPH9q0aZMwj5ut3/3799Pw4cPJ1taWHBwcaMiQIaRWq2+6LjvLe++9R9bW1pSVlSV2KeaiZ25uT5s2jcLDw81ms+KPYaNSqejLL78kuVxODz300A3tX3/9dZJKpbRhwwaqqamhrKwsGjZsGLm6ulJpaanQLj4+3iBIiIhWrlxpECRERLGxscKbt9ULL7xANjY2tG3bNlKpVLRixQqysLAw2Md4q5Csra0lAOTt7X3btScmJhIAevvtt6mqqoqqq6vpX//6F8XHx9/Wsv3tb38jAJSRkUH19fVUWVlJkydPJgD0n//8hyoqKqi+vp6WLFlCACgzM7Pd6+CVV14hALR3715Sq9VUXl5Oo0ePJjs7O2pqarrp+q2rqyNHR0d69913qaGhgUpLSykmJsagbrHo9XoKDw+nqVOnil2Kueh5IalSqUgqldJXX30ldikCf39/YaTR+pBIJPTmm28avNmIft+/ZW9vT3FxcQbTf/31VwJAb7zxhjDtTkOyoaGB5HK5QR9arVbYZ3V93cZCkohIIpGQk5PTbdXe1NRETk5OFB0dbdBOp9PRqlWrbmvZWkNSo9EI09atW0cA6MyZMzfU0DpSbM86aA3JhoYGoU1SUhIBoPPnzwvT/rh+f/vtNwJAu3btMrruxLJp0yaytram6upqsUsxBz1vn+SZM2fQ1NSE6OhosUsxoFAoQEQgIixfvhxEBIVCccM1A7Ozs1FXV3fD2T/Dhw+HVCpFRkbGXdeSl5cHrVaLIUOGCNNsbW3h7u6O3Nzcds+nvr4eRCRcZKG9tWdlZaGmpgaTJk0yaGdpaYmlS5fe6WIJWi9ee/3dElvXc+u9wu90HbTOu3U+bfHz84NSqcSsWbPw97//HUVFRXe8LB0hOjpauK4l64HHSbbePMucz71+7bXX4O7ujhUrVuDSpUsGv2u93aq9vf0Nr3NychJuu3o3Wm8x++qrrxocB1lcXCzcq6U98vPzAQADBgwA0P7aW+/jLeb/kanWQVtsbW3x888/IyoqCm+99Rb8/PwQFxdncHdLMTk7OwNAm7f27Yl6XEh6enoCgFkepN3KwcEB77zzDjQaDRYtWmTwu9bgaCsMa2pq4OXlddf99+7dGwCQmJgojG5bH+np6e2ezw8//AAAeOCBBwC0v/bW/6Prb+Pa2Uy1Dm5m8ODB+Pbbb1FSUoIXX3wRX3/9Nd577727nq8pFBYWAoBJ/pa6gx4XkiEhIejduze2b98udilGzZ49GyNGjMCuXbuwZcsWYfqQIUNgb2+P48ePG7TPyMhAU1MTwsPDhWlWVlZGN/tuxtvbGzKZDJmZmXdcf2lpKRITE+Hl5YWnn376tmrv27cvevXqhd27d990/ne6bO1linVwMyUlJcjJyQHwexi//fbbGDZsmDBNbNu3b4erqytCQ0PFLsUs9LiQtLS0xPz585GYmCjqSOVWJBIJPvroI0gkEixZskQ4xU8mk2HZsmXYvn07Nm7ciNraWpw5cwYLFy6Eh4cH5s+fL8wjICAA1dXVSEtLQ3NzMyoqKlBcXHxDX7169UJJSQmKioqg0WhgaWmJOXPmYPPmzVi9ejVqa2vR0tKCy5cv4+rVqwavJSLU1dVBr9eDiFBRUYGvv/4ao0aNgqWlJdLS0oR9ku2t3cbGBitWrMDBgwexZMkSXLlyBXq9HhqNRgiS9i7bnZLJZO1eB7fyx/VbXFyMBQsWIDc3F01NTTh16hSKi4sRERFhsvrvVGVlJT744APMnz+f787ZSoyvi8RWU1NDvr6+9OCDD5JOpxOtjiNHjlBQUJDwjbanpyctWLDAoE1CQgIBICcnJ3r77beJ6PfDNFauXEmBgYFkbW1Nzs7ONG3aNMrLyzN4bVVVFUVHR5NMJqN+/frRs88+Kxx7GRAQQBcvXiQiopMnT5Kvry/Z2tpSVFQUlZaW0rVr1+jFF18kHx8fsrKyot69e1NsbCxlZ2fT3RZOhwAAIABJREFUzp07KTg4mORyOUmlUrKwsBC+kXdycqJ7772X3njjDaqqqrphmdtbOxHRJ598QkOHDiWZTEYymYzCwsIoKSmp3cu2atUq4djJvn370qFDh+idd94hhUJBAMjNzY2++uorSklJITc3NwJAzs7OtHnzZiIio+ug9ThJABQYGEgFBQX0+eefk6OjIwEgX19fys/Pb3P9ZmRkUGRkJDk7O5OlpSV5enrSK6+8IurfItHvRw88+OCD5OvraxbHbJqJ6h57PcmMjAxER0dj5syZSE5OhoVFjxtUMyZoaWnBvHnz8PXXX2Pfvn0YMWKE2CWZC1WPTYYRI0Zgx44dSElJwdSpU03yrTBjXZFGo8G0adOQkpKCHTt2cED+QY8NSQCYNGkS9u3bh2PHjiE4OBh79uwRuyTGOtWhQ4cQHh6O9PR07N69+4ZjU1kPD0kAiIiIQGZmJoYPH477778fM2bMQHV1tdhlMdah1Go15s+fj7Fjx6J///7IzMzE6NGjxS7LLPXYfZJtSU1NxeLFiwEAy5cvx4IFC2BnZydyVYyZTn19PT777DOsXLkSAPDJJ59g+vTpIldl1vhGYH9UXV2Nd955B6tXr4adnR2WLVuGRYsWtXmWCGNdRV1dHVavXo33338f9fX1WLhwIV5++WX06tVL7NLMHYfkzVRUVOCDDz5AUlISpFIpEhISMG/ePOEUO8a6grNnz2LNmjVYt24dmpqasHjxYjz//PPCGUXsljgkb6WqqgqffvopkpOTUVRUhKioKMybNw+PPfYY5HK52OUxdgOtVoutW7dizZo1OHz4MPr27Yu5c+di4cKFcHFxEbu8roZDsr30ej1++uknrFmzBt988w1sbW0xZcoUTJs2DQ888AAHJhOVVqvF999/jx07duDbb79FY2MjHn30UcybNw/33XcfHwd85zgk70RFRQU2bdqE7du348iRI5BKpZg0aRJiYmIwZcoU4SoqjHUklUqFb7/9Fjt27MCPP/6IpqYmjBo1CjExMXjiiSd4k9o0OCTvVlVVFf7zn/9g6/+xd99hUZzr38C/C7ssu5RdlKo0FRCxoALHAlZiYo0tGo+IJQaNnliSaBJT9cSo0aiJxhpjr1hiFBWFGA0ahUMTIlJsgKEtfYGlLHu/f/hjXhHsLLPA87muuZTdYebL7Ow9z8zOPs/RowgJCYFarUb37t3x2muv4bXXXoOPjw8MDQ35jsk0A2q1Gjdu3EBoaChCQ0Nx+fJlaDQa9O7dGxMmTMDEiRNhY2PDd8zmhhXJhlRUVISQkBD8/vvv+P3335GSkgKJRAJvb2/4+vrCx8cHHh4ekEgkfEdlmgCVSoWoqChcuXIFv//+O65evQqVSgVnZ2f4+vrC19cXr7/+OteBCKMVrEhqU1paGlcwL168iMzMTIhEInTr1g29evXiJhcXFwgEAr7jMjwiIiQnJyM8PBwRERG4fv064uLiUFVVBWtra64o+vr6wt7enu+4LQkrko3p3r17uH79OvdGiI6ORkVFBVq1aoWePXuiW7du6Nq1K7p16wY3Nzd2mt5MlZeX4+bNm4iPj0d8fDzi4uIQFRWFgoICiMVi9OzZE//617/Qq1cv9O7dG+3ateM7ckvGiiSfKisrERsbi/DwcMTGxiIuLg43b96ESqWCUCiEs7MzVzQ7duwIZ2dnODs7s0/Sm4jS0lKkpKTg9u3bSExMRFxcHOLj45GSkoLq6mpIJBJ07twZ3bp1Q/fu3dGrVy90796dGyeH0QmsSOqa6upq3L59m3tD1bQ0UlNTUV1dDQBo27YtVzCdnJzg7OyMDh06wNbWln2DopHl5+cjPT0dd+/eRUpKSq0pIyMDAKCnpwcHB4daZwrdunWDk5MT69hW97Ei2VRUVlbi7t27SE5O5t6Et2/fRkpKCtLT01HzMhoZGcHBwQF2dnaws7ODra0tHB0dYWtrCxsbG1hYWLBbQ56TQqGAQqFAZmYmHjx4gPv37yM9PR0PHjxAeno6UlNTuQHDBAIB7Ozsah24nJyc4OLigvbt20MsFvP81zAviRXJ5qC8vBz37t3j3rxpaWlIS0tDeno69/OjI/EJhUKuWFpbW8PS0hIWFhawsrJC69atIZfLa00ymQxyubzO8LZNRVVVFQoLC1FUVITCwsJaU15eHrKzs6FQKJCTk4OsrCyuOD465KxEIoG9vT138LG3t+d+trW1Rbt27dg15OaJFcmWQqFQIDs7u04hyMrKQk5ODvd8fn4+N+zu44yMjLiCKZFIYGJiAqFQCLlcDj09PcjlcgiFQpiYmMDAwKBWD0r13WAvkUjqFJby8vJ6h1atGeMHeHitr7KyEkqlEmq1GoWFhdBoNCgsLOR+LikpQVlZGYqKirjW3uNkMhlatWoFKysr7qDxaGu75gBS8zzTIrEiydRFRLVaWzUtsEdbYiqVCmfOnIGJiQns7e1RXV3NFSmlUlmr2NU89riaIveomiL7uJqCDPz/4mpsbAyRSAS5XA59fX3IZDKIRCJcvnwZmZmZWLRoEWxsbLjCXvNvzcRuu2KeAyuSzMs5evQo3n77bZw4cQJjxozhO04t2dnZ8PT0hJubG86ePcs+HGFeRcsd44Z5eXfv3kVAQADef/99nSuQAGBlZYVjx47h8uXLWLZsGd9xmCaOtSSZF1JVVYUBAwagpKQE4eHhOv0Vy71792L69OkIDAxkvW8zL6tAyHcCpmlZsmQJ4uLiEBkZqdMFEgCmTp2Kv/76CzNmzECnTp3QuXNnviMxTRBrSTLPLTg4GMOHD8fu3bsxdepUvuM8l6qqKvj6+iI7OxsRERGQyWR8R2KaFvbBDfN8srOz0b17d7zxxhvYvXs333FeSFZWFjw9PeHh4YFff/2VdUDLvAj2wQ3zbBqNBlOmTIGxsTE2btzId5wXZm1tjaNHjyI4OBjLly/nOw7TxLAiyTzT8uXLERYWhsDAwHrvYWwK+vTpg/Xr12PZsmUICgriOw7ThLDTbeapwsLCMHjwYKxfvx7vv/8+33FeWUBAAI4cOYLw8HB06tSJ7ziM7mPXJJknKygoQI8ePdClSxecPn26WXxDpaKiAv3790dxcTHCw8NZr97Ms7Brkkz9iAgzZsxAdXU19uzZ0ywKJACIxWIcO3YM+fn5mDlzJlgbgXkWViSZem3YsAFnzpzB4cOHm91YzXZ2dggMDMTJkyfxww8/8B2H0XGsSDJ1xMXF4dNPP8XSpUvh7e3NdxytGDBgAJYvX46PP/4YYWFhfMdhdBi7JsnUUlJSAk9PT9jY2CA0NLRZdw5BRBg/fjyuXbuGmJgYWFtb8x2J0T3sgxumtqlTpyI4OBixsbFo06YN33G0rrCwEB4eHnBwcEBISEizPigwL4V9cMP8f7t378b+/fuxc+fOFlEgAUAul+PEiRO4fv066zGIqRdrSTIAgJSUFHh4eGDOnDn47rvv+I7T6LZt24a5c+ciKCgIw4YN4zsOozvY6Tbz8N7BPn36QCgU4sqVKy12SNPp06fj1KlTiIqKYmNdMzVYkWSA//znPzhw4ABiYmJadHFQqVTo27cvDAwM8Oeff7IRDhmAXZNkgoKCsGXLFmzZsqVFF0jg4dg5gYGBSExMxOLFi/mOw+gI1pJswdLT09GjRw+89dZb2Lp1K99xdEZgYCDefvtt7N27F/7+/nzHYfjFTrdbKrVajYEDB6KwsBARERGQSqV8R9IpCxYswM6dOxEeHg43Nze+4zD8YUWypfrss8+wfv16hIeHo1u3bnzH0TmVlZUYMGAAlEolwsPDa40hzrQo7JpkS3Tp0iWsXr0aP/30EyuQT2BgYIAjR44gKysL8+fP5zsOwyPWkmxhcnJy0L17d/j4+CAwMJDvODrv7NmzGDlyJA4cOIB///vffMdhGh9rSbYkGo0G/v7+kEgk+Pnnn/mOwwuNRoP169ejb9++zzX/8OHDMWfOHMyZMwf379/Xbrgm7L///S/c3NxgamoKsVgMJycnfPzxxygpKeE72qsjpsVYuXIliUQiunbtGt9ReJGcnEze3t4EgNzd3Z/791QqFbm7u9O//vUvqqys1GLCpmvAgAG0adMmysvLo+LiYjpy5AiJRCIaOnQo39FeVT4rki1EeHg4GRgY0Nq1a7Wy/LKyMurTp49Wlt0Q64iNjaVx48bR/v37qXv37i9UJImI/v77b5JIJPTVV1+91Ppfla5v3xEjRpBara712MSJEwkApaWlNUQ8vuSz0+0WoLCwEJMmTYKvry8++OADrazjl19+QU5OjlaW3RDrcHd3x/Hjx+Hn5/dS36Tp3Lkzvv/+eyxfvhwXL158qQyvQte3b1BQUJ0elMzNzQEAZWVlr5yNV3yXaUb7Jk2aRFZWVpSVlcU9ptFoaO3ateTq6koGBgYkl8tp9OjRdOvWLW6eefPmkUgkIisrK+6xuXPnklQqJQCkUCiIiGjBggVkYGBAAAgAdejQgX788UcSi8VkYWFBs2fPJmtraxKLxdSnTx+6fv16g6zjZfXq1euFW5I1xowZQ7a2tpSbm/vU+Vry9q0xevRokkgkVFFR8crL4hE73W7uNm/eTHp6ehQaGlrr8a+++ooMDAxo3759VFhYSHFxcdSzZ08yNzevVUz9/PxqvcGIiNasWVPrDUZENH78+DpvrNmzZ5ORkRElJCRQeXk53bx5k7y8vMjExKTWKdirrONlvEqRzM/PJ3t7exo7duxT52vJ25eIqLS0lExMTGj+/PkNsjwesdPt5uzvv//GRx99hC+//BK+vr7c4yqVCuvWrcO4ceMwZcoUyGQydO3aFVu3bkVubi62b9/eYBmEQiE6deoEsVgMNzc3bN68GUqlErt27WqwdTQmMzMz7Nu3D6dOnXridmLbF1ixYgVsbGywfPlyXnM0BFYkm6nS0lJMnDgRnp6e+PLLL2s9d/PmTW6Yhkd5eXnBwMAA4eHhWsvl6ekJqVSKxMREra1D2/r3749PP/0UCxYsQHx8fJ3nW/r2PXHiBAIDA3H+/HmYmJjwlqOhsCLZTM2bNw9ZWVnYv39/nQvqhYWFAABjY+M6vyeXy6FUKrWaTSwWQ6FQaHUd2rZ06VL07NkTkydPhkqlqvVcS96+hw8fxqpVq3Dp0iU4OjrykqGhsSLZDAUGBmL37t3YtWsX7O3t6zwvl8sBoN43a2FhIWxtbbWWraqqSuvraAxCoRCHDx/GP//8g08//bTWcy11+27cuBH79+/HxYsXm9XwH6xINjN37txBQEAAFixYgNGjR9c7T5cuXWBsbIzIyMhaj4eHh6OyshIeHh7cY0KhEFVVVQ2W79KlSyAi9O7dW2vraCx2dnbYtm0bNm7ciFOnTnGPt7TtS0T45JNPEB8fj5MnT9bbgm7KWJFsRqqqquDn5wdnZ2esWrXqifMZGhrio48+wokTJ7B//34UFxcjPj4ec+bMgY2NDWbPns3N6+TkhPz8fJw8eRJVVVVQKBRITU2ts8xWrVohIyMD9+/fh1Kp5N6UGo0GBQUFUKvViIuLw8KFC2Fvb4/p06c32Dr4NGHCBEybNg0zZ85ERkYGgJa3fRMSErB69Wr8/PPPEIlEEAgEtabvv//+RTap7uH543WmAS1cuJCMjY0pMTHxmfNqNBpas2YNOTs7k0gkIjMzMxo7diwlJSXVmi8vL48GDRpEhoaG1K5dO5o3bx4tXryYAJCTkxN3q0l0dDQ5ODiQRCIhHx8fysrKotmzZ5NIJKK2bduSUCgkU1NTGjNmDN25c6fB1vG8rl27Rt7e3mRjY8PdC2htbU19+/aly5cvP/dy6lNSUkIdO3akAQMGcN86aUnbNz4+ntum9U1r1qx5pe3LM3afZHNx9uxZEggEtG/fPr6jcGbPnk2tWrXiO0ajiIqKIgMDA/ruu+8abZ0tafvyiN0n2Rz8888/mDp1KmbMmIEpU6bwHaeW6upqviM0ip49e2LFihX44osv6lyL1KaWsn35xIpkE6fRaDB16lSYmZnhhx9+4DtOo0lMTKxz7au+adKkSY2W6cMPP8TAgQPh7+/f5L+vrIvblzd8t2WZV/P111+ToaEhxcTE8B2lliVLlnDfBXZ0dKSjR4/yHalR/PPPP9SqVSt6//33tbqelrp9eZDPeiZvwv78808MHjwYGzduxJw5c/iOw/yf48ePY8KECThz5gyGDRvGdxzm1bCBwJqq/Px89OjRA56enjh+/DjfcZjHTJ48GZcvX0ZcXBxat27Ndxzm5bEi2RQREcaMGYOYmBjExsaiVatWfEdiHlNYWAh3d3d2EGv62Bg3TdH69etx9uxZHD58mBVIHSWXy/HLL7/g119/xcGDB/mOw7wC1pJsYqKiotC3b18sW7aszneGGd2zYMEC7NmzB3FxcfV+j57Reex0uykpKSmBh4cH2rZti5CQkDq9+zC6p7y8HF5eXrCyssKFCxegp8dO3poYdrrdlLz33nsoLCzEgQMHWIFsIgwNDbFnzx6EhYVh48aNfMdhXgIrkk3Ejh07cOjQIezfvx82NjZ8x2FeQM+ePfHFF19wPeUwTQs73W4CEhIS4OXlhQULFmDFihV8x2FeglqtRr9+/VBRUYHr16/DwMCA70jM82HXJHVdeXk5evfuDbFYjCtXrkAkEvEdiXlJd+/eRffu3TF//vxmMfZLC8GuSeq6hQsXIjU1FUeOHGEFsolr3749Vq9ejZUrV+LPP//kOw7znFiR1AGhoaHYs2dPncePHz+Obdu2YcuWLc1mvJCWbvbs2Rg2bBhmzJhRZ3iHCxcu4L333uMpGfNEPHxhnHnMu+++SwDIz8+PiouLiYgoNTWVWrVqRf/5z394Tsc0tOzsbLK0tKRZs2YREVFxcTHNmjWLBAIBSSQSqqio4Dkh8wjWwQXfNBoNLC0tkZeXB6FQCDs7OwQGBmL+/PlQKpWIiIiARCLhOybTwE6ePIlx48bh22+/xebNm5Gdnc0Nl/Dnn3+iX79+PCdk/g/74IZv165dQ9++fbmfhUIhAEAqleL69evo1KkTX9EYLVKpVPDx8UFMTAz09PS4znMNDAywZMkSLF26lN+ATA32wQ3fTp06Vet2ELVaDbVajZKSEixevBh5eXk8pmO04fr16+jSpQvi4uJARLV6F6+srERwcDCP6ZjHsZYkz5ydnXH79u16nxOJRGjVqhUCAwPRv3//Rk7GNLTy8nJ8/fXX+P777yEQCJ449IK+vj4KCgpgYmLSyAmZerCWJJ9u3779xAIJgBv+c/Dgwdi0aVMjJmO0ISgoCOvXrwfw9LFpqqur2S1COoQVSR6dOnWKuwb5JESEESNGYMKECY2UitGWt956C9euXYOdnd1T73k1MDDA77//3ojJmKdhRZJHx48ff2KLQiQSQSqVYuvWrfjtt99gaWnZyOkYbfDw8EBcXBzGjh37xHkqKytx9uzZRkzFPA27JsmTvLw8WFlZ1Vsk9fT00K9fP+zbtw92dnY8pGMaw969ezFr1ixUV1dDrVbXek4gECAjIwPW1tY8pWP+D7smyZegoCA8fnwSCoUwMDDAihUrcPHiRVYgm7mpU6ciOjoa7du3r3P6LRAIcPHiRZ6SMY9iRZInJ0+erNUBq76+Ptzd3REXF4dPPvmEdc7aQri5uSEqKgoTJ04E8LA4Ag/PJkJDQ/mMxvwfdrrNg4qKCpiZmUGlUkEoFIKI8MUXX+DLL79knem2YHv37sXs2bO5e2Wtra2RmZnJd6yWjn3jBnh4A7dSqURhYSFKSkpQWVkJpVJZ6zpRWVkZKioquJ/19PQgk8lqLUcul0MgEMDMzAzGxsYwNjaGVCqts75z585h+PDhAB62JA4dOoRu3bpp6a9jmpKEhASMHTsWycnJAIDk5GQ4OzsDePiBTmlpKQoKCrj9UaVSoby8nPt9IkJhYWGtZQqFwjr3XJqamkJfXx8mJiaQSqUwMjKCmZmZlv+6Jqng6fefNFHl5eVITU1Feno6srKyoFAokJOTg+zsbCgUCigUCuTm5qKoqAglJSW1drKGVlNMZTIZTE1NYWVlhfv370MgEKB///7w8/NDWloaqqur4ejoyHbUFqK8vBzp6en4559/kJWVhdzcXG7q1q0blEolMjMz0adPH2g0mjoHbW2pKZgmJiZo3bo1zM3Na01WVlYwNzeHpaUlHBwcYG1t3ewvDTXZlmReXh5u3bqFW7du4c6dO0hNTcX9+/eRmppa6xTFwMCAe1Gtra1hYWHBTTKZDMbGxjAyMoKpqSn3s1gshkQigaGhIbccsVhcq1VYVVWFkpIS7meNRoOioiLuX6VSiZKSEpSUlKC4uBhFRUUoKipCVlYWTp48CWtra6hUKmRnZ6O0tJRbjqmpKRwcHODo6Ih27drB0dERrq6ucHV1haOjI3fNitFtVVVVuHfvHpKSkpCSkoK0tDSkpaUhPT0d6enpyM7O5ubV09OrtxgpFAqkpaVh5syZ3H5qZGQEuVwOqVQKQ0NDGBgYwMjIqNa6ZTJZrcJVXl4OlUpVa56CggIAQHFxMcrKylBWVsa1UMvKylBcXFyrcOfm5nKNjUe7eBOJRGjbti3s7Ozg4OAAOzs7ODo6wsXFBS4uLmjTpo02Nm9j0v3TbZVKhdjYWERFReHmzZtITEzEzZs3oVAoAAAmJibo0KEDV1hqppoXzNzcnOe/oLaKigpUV1fXKrhlZWVIT0/ninzNv6mpqbhz5w6ysrIAPDzK1xTMzp07o3v37vD09GT3UPKooqICf//9N2JiYpCYmIikpCQkJyfj3r17XK8+NjY2aNeuHezs7LjJwcEBtra2sLW1haWl5RMPftnZ2bCysmrMP+mZKioqkJWVhfT0dKSmpuLBgwdIT0/nDgT37t1DcXExgIfvz5qC6eLigq5du6JHjx5o165dUzng61aR1Gg0iI+Px/Xr1xEZGYnIyEj8/fffUKvVMDMzQ9euXdGpUyducnV1bRFjGRcWFuLWrVtISEhAYmIiEhIScOvWLdy7dw8A4ODgAE9PT3h5ecHLywu9evWq07pgXp1KpUJkZCSio6MRGxuLmJgYJCQkoKqqCkZGRujUqRNcXFzQsWPHWoXB2NiY7+iNLisriztg1EyJiYm4c+cOqqurIZPJ0L17d/To0QM9evSAh4cH3NzcdLFw8l8k7969i9DQUISGhuLixYvIy8uDsbEx3N3d4eHhwU06ugF5VVRUhPj4eERFRXFTQkIChEIh3N3d8dprr8Hb2xsDBgyAqakp33GbnOLiYkRERODKlSu4evUqrly5gvLycshkMnTp0qXW/unq6sruTHgOlZWVSElJqbXPxsTEoKysDCYmJujVqxe8vb3h4+MDHx+fWpe8eNL4RbKoqAjBwcH47bffcP78eeTn56N169bo168fBg0ahIEDB6JLly7N/mKwtmRkZODSpUvclJKSAgMDA3h7e2PUqFF488030aFDB75j6qSKigr8+eefCA4ORnBwMG7dugWBQAA3Nzf069cP3t7e8Pb2ZkNpNDC1Wo0bN27gypUr3AEpMzMThoaG6NOnD4YOHYphw4aha9eufMRrnCKZmZmJ48eP49SpU7h8+TI0Gg369++PkSNHYvDgwejatSsrilqSkZGBP/74A+fOncPZs2dRUFCAzp07480338T48ePh4eHBd0ReZWRk4LfffsO5c+dw8eJFlJaWokuXLhg6dCgGDhwIb29vyOVyvmO2OHfu3MHVq1cREhKC8+fPQ6FQwM7ODkOHDsXw4cPxxhtvNFaP/dorkhUVFbhw4QL27duHkydPQiQSYfDgwRg1ahTGjBnDPmzgQXV1Na5du4agoCCcPHkSSUlJcHV1xdtvv43p06e3mBZSfn4+goKCcPToUQQHB8PAwAB9+/bFyJEjMWbMGDg4OPAdkXmERqNBTEwMd1nu0qVLEIlEGDlyJPz9/fHGG29ocxzzggYfCCw+Pp4CAgJIJpORUCikESNG0JEjR0ilUjX0qphXdP36dZo7dy61atWK9PT0aMiQIXTixAmqrq7mO1qDq6yspMDAQHrjjTdIKBSSVCqlt99+m3799Ve2bzYxmZmZtGHDBurbty8JBAJq1aoVzZ49m6Kjo7WxuvwGK5IhISE0dOhQEggE1KlTJ1q3bh1lZWU11OIZLSovL6fjx4/TiBEjSE9Pj5ydnWnz5s1UWlrKd7RXlpmZScuWLaM2bdqQvr4+jRo1ig4ePEglJSV8R2MaQGpqKq1evZo6d+5MAKhv37504MCBhhxx8tWL5JkzZ6h79+4EgAYNGkRBQUGk0WgaIhzDg8TERJo1axZJJBIyNzenlStXUllZGd+xXlhycjL5+/uTgYEBmZub0yeffEL37t3jOxajRX/88Qe99dZbJBQKycrKilauXNkQB8OXL5LR0dHk6+tLAGjcuHEUFRX1qmEYHZKTk0NffPEFGRkZkb29Pe3du7dJnIbfv3+fZs6cSUKhkFxdXWnXrl3sdLqFSU9PpyVLlpCJiQlZWVnRDz/88Cr7wIsXyeLiYnr33XdJT0+PevfuTVeuXHnZlTNNQEZGBgUEBJC+vj55eHhQfHw835HqVVpaSosWLSIDAwNq37497d69m9RqNd+xGB4pFApatGgRSaVSsrW1paNHj77MYl6sSF69epXat29PlpaWdPjwYXZa3YLEx8eTt7c3GRoa0tq1a3WqVXnp0iVycnIiuVxOmzdvpsrKSr4jMTokIyODZs6cSQKBgMaNG0eZmZkv8uvPXyS/+eYb0tfXp5EjR7IPZFootVpN3377LYlEIvL19aX8/Hxe81RWVtK8efNIIBDQm2++Sf/88w+veRjdFhoaSu3btyczMzM6fvz48/7as4ukWq2m9957j4RCIW3atIm1HhmKjIwke3t76tKlC2+FqaCggF577TUyNjamAwcO8JKBaXpKS0vpvffeIz09Pfruu++e51cvdGMjAAAgAElEQVSeXiSrqqrorbfeIolEQqdOnWqYlPV4++23CcBzTadPn9ZajmPHjlG7du3qrFMsFpOjoyPNmDGD7t69q7X115g5cyYZGxsTAIqJidH6+l5Geno6ubm5kaOjI925c6dR152amkpubm7Utm1bbd0bR0QNu196enqSnp4eubu7P3W+NWvWkIWFBQGgLVu2PFdOtt++uA0bNpC+vj4FBAQ869LR04vkxx9/TEZGRvTnn382bMLHvP3223ThwgUqLCykqqoqyszMJAD05ptvUmVlJZWWllJOTg4FBARotUjW6NChA8lkMiIiqq6upuzsbNq7dy9JpVKytLSk3NxcrWc4dOiQzu9subm51LNnT+ratWuj3VOZk5NDLi4u1K1bN3rw4IFW19XQ+6Wvr+8ziyQRUUpKygsVyRpsv30xQUFBJBaL6bPPPnvabPlP/MJ0UFAQ1qxZg02bNqFfv34N8v2eJxEIBPD29oZMJoNQKKz1eM340xYWFg3+PWOVSoW+ffs+dR49PT1YWlrC398f77//PnJyctgATf+ndevWOHnyJDIzMxEQEKD19Wk0GkyZMgVVVVU4f/482rZtq9X1aWO/bKyerNh++2wjRozAtm3bsHLlShw+fPiJ89U7fENRURFmzJiBmTNnYtq0aVoLWePQoUPPNd/s2bMbdL2//PILcnJynnt+JycnAOA6wdWmptItnJ2dHfbs2YORI0di0qRJGDVqlNbWtWPHDvzxxx+4evVqo4xHrY398vGhYxsD22+fbNq0aYiLi8O7774LHx8f2Nra1pmn3pbkhg0boNFosGbNGq2HfBnV1dX46quvYG9vD4lEgm7duuHIkSMAgN27d8PY2JgbkOvkyZOIjIyEg4MD9PX1MXnyZADAwoUL8dFHH+HOnTsQCATcjvQ0KSkpAAB3d/fnzgMAYWFhcHNzg0wmg6GhIbp27Yrz589zzxMR1qxZg44dO0IsFkMmk2Hx4sUv9HevXr0aUqkUJiYmyMnJwUcffYS2bdsiKSnpBbfuixs+fDjGjx+Pr7/+WmvrKC8vx5dffon//Oc/8PLy0tp6XsWzXmcAuH37NlxdXWFkZASJRIJ+/frhypUrz1z2s/axp2H77dOtWLEC1tbWWLZsWf0z1HcS3r59e1q0aJE2LgM8l5prP6NHj673+UWLFpFYLKZjx45RQUEBffbZZ6Snp0f/+9//iIgoISGBpFIpTZs2jfudJUuW0I4dO2otZ/z48dShQ4c6y3/02g7Rw09Sd+/eTVKplEaMGPHCeY4ePUpLly6l/Px8ysvLo969e1Pr1q253//8889JIBDQ2rVrqaCggMrKymjTpk11ru08az2ff/45AaAFCxbQxo0bady4cXTr1q1nbe4G8ddff2n1WtTBgwdJJBJRRkaGVpb/PJ61Xz7rdfb19aX27dvTvXv3qKqqiv7++2/q1asXGRoaUnJyMjdffdckn/XaE7H99lVs3ryZpFIpFRUVPf5U3Q9u7t69SwAoLCyscdLV42k7o0qlIqlUSpMmTeIeKysrI7FYTHPnzuUe27ZtGwGg/fv308GDB+nDDz+ss6ynFUk89kmhQCCg5cuX17lR+XnzPGrFihUEgHJycqisrIykUikNGTKk1jyPXwB/nvXU7Gx8fQ3PysqK1qxZo5VlT58+nQYNGqSVZT+vZxXJxz36OhPV/8FNXFwcAajVKHm8SD7vPsb225enUChIIBDU9wFc3Q9uasb75akX4GdKSkpCWVkZunTpwj0mkUhgbW2NxMRE7rFZs2bhrbfewnvvvYfAwECsXr36hdYjk8lARCAiLF68GEQEmUxW55rS8+Z5VM0yqqurcfv2bZSVlcHX17dB/m4+de3aldt/GlpiYiJ69OihlWVry6Ov85N07doVMpkMcXFxT5znRV57tt++HHNzc9jZ2dWbqU6RLCsrA4Bao/npkprhV7/44gsIBAJuSk1N5bLX+Pbbb1FSUvJCH87U58svv4S1tTU+++wzpKenv3CeM2fOYODAgbCwsIBYLMbHH3/M/f6DBw8AABYWFg32d/PFyMio1vC4Dam0tFTnBzd72uv8NCKRiBtZsT4v+9qz/fbFmJiY1BomukadItm6dWsA4IZs1TU1L8r69eu5I2bNdO3aNW6+qqoqLFiwAOvWrcO1a9ewfPnyl16niYkJVq1aBaVSiblz575QnrS0NIwdOxbW1tYIDw9HUVERvvvuO+73awY6qqioaJC/m085OTlaG8LX3Ny8UT6dfVnPep2fRK1WIz8//6mjfr7sa8/22+dHRMjKyqp3xIQ6RdLd3R16eno69Qc8ys7ODoaGhoiNjX3qfPPmzUNAQAA++OADfPjhh/jmm29e6W+aOnUqevXqhaCgIAQGBj53nvj4eFRVVWHu3Llo3749DA0Na90mUTPo2eXLl5+6/uf9u/lSMz56z549tbJ8T09PhIWFaWXZDeFZr/OT/PHHH9BoNE/dbq/y2rP99vkkJCQgLy8Pnp6edZ6rUyRlMhkGDBiAAwcONEq4F2VoaIgZM2bg0KFD2Lx5M4qLi1FdXY0HDx4gMzMTALBp0ya0bdsW48aNA/DwI343Nzf4+flxg6YDQKtWrZCRkYH79+9DqVQ+9ZRHIBBgw4YNEAgEmD9/PgoKCp4rT00LITQ0FOXl5UhJSUF4eDi3XAsLC4wfPx7Hjh3DL7/8guLiYsTFxWH79u0v/Hfz6dixY1Cr1Rg2bJhWlj9+/HgkJibir7/+0sryX9WzXucalZWVKCoqglqtRnR0NObPnw8HBwdMnz79ict+ldee7bfPZ8eOHXB0dKy3SNZ7C9DRo0dJT0+v0b9aVFxcTP3796dWrVoRANLT0yMnJyf69ttva81XUVFBn3zyCdnb25NQKCQLCwsaP3483bx5k0aNGsWNe/HXX38REdEHH3xAenp6BIBkMhlFRkYS0cOOgx0cHEgikZCPjw+dOHGCXFxcuE8G27RpQ++9916tdU+fPp0AkFwup5UrVz4zDxHRJ598Qq1atSK5XE4TJkygn376iQBQhw4dKC0tjZRKJb377rvUunVrMjY2Jh8fH/rqq68IANna2tKNGzeeuZ7vvvuOJBIJASA7Ozvat2+fVl+rR1VVVZGrqytNnjxZq+vx9vam/v37N3onK8+7Xz7rdd61axcNGjSILC0tSSgUUuvWrenf//43paamcstYu3YtWVlZEQAyMjKicePGEdHTX/urV6+y/fYV3Lt3jwwNDemHH36o7+n8ekdLJCL069cPRUVFuH79us5fMGf4tWjRImzduhU3btzQ6pjekZGR6NOnD9asWYOFCxdqbT1My6FWqzF48GDk5+cjOjq6vlEXnzxaYnp6OllYWNC///1vLdVvpjn47bffSCAQ0J49explfStXriShUNgoHZ0wzZtGo6F33nmHpFIpxcXFPWm2p/cCFBwcTHp6evThhx+yfiSZOoKDg8nIyKjOqZ02aTQaevfdd0ksFrN+JJmXVlFRQVOnTiWRSERBQUFPm/XZne6eOHGCDA0NacqUKaxbfIZz4sQJEovFvOwXGo2Gvv76axIIBPT111+zAzjzQvLz82nQoEFkbGz8rAJJ9LzDN5w/f56MjY1p8ODBlJaW9uopmSarsrKS++4t32cYW7ZsIaFQSKNHj2ZDNzDP5eLFi9ShQweyt7d/2in2o55/jJvo6Gjq1KkTyeVyOnjw4MunZJqshIQE6tmzJxkZGdHWrVv5jkNEDwcB69ChA8nlcvrll19Yq5KpV2FhIQUEBJBAIKAxY8a8yDhdLzZaYllZGTfw0ujRoykpKenF0zJNjlKppK+++ookEgn16tWrVo81uqC0tJQ+/PBD0tfXp/79+/PaOQujWyoqKmjLli3Upk0bsrKyosDAwBddxIuPu030cNSxLl26kEgkovfff58UCsXLLIbRcWq1mrZv307W1tYkl8tp9erVVFVVxXesJ4qIiKCBAwcSABo6dGitbsSYlkWtVtPu3bupXbt2JBaLad68eS87fMXLFcmaED///DPZ2NiQqakpLV68mNLT0192cYwOUalUtH37dnJ1dSWRSETz5s1rUgfCkJAQ6t27NwkEAnrjjTfo9OnTOjVOOKM9BQUFtH79enJyciKhUEjvvvturZv1X8LLF8kaJSUltHLlSmrTpg2JRCKaMmWKVkewY7QnJyeHli1bRpaWliQWi+mdd97RuVPrFxEUFERDhgwhgUBA7du3p9WrV1NeXh7fsRgtuHHjBs2aNYuMjIzI2NiY5syZQykpKQ2x6FcvkjUqKiooMDCQvLy8CAC5ubnRqlWruA5HGd2kVqspJCSE/P39SSqVkkwmo/nz5zers4KUlBTuK3ZisZhGjhxJe/bsoeLiYr6jMa8gPT2dfvjhB/L29iYA5OzsTKtWrWroA2HDFckaGo2GLl68SFOnTiUjIyMyMDCgcePG0YkTJxpt2FHm6TQaDYWHh9MHH3xAVlZWJBAIaMCAAbRz504qKSnhO57WKJVK2r17Nw0dOpSEQiHXY/bx48dZwWwi7t27Rxs3biRvb2+uj4aAgAC6dOmStu5sqP+72w2lpKQEx48fx549e3D58mWIxWL4+vrizTffxKhRoxplxDvmIZVKhYsXL+LUqVM4ffo0MjMz4eTkBH9/f/j7+6Ndu3Z8R2xUubm5OHbsGA4fPoywsDDo6+vDx8cHQ4cOxbBhw3S2Z/6WpqKiAn/++SeCg4Nx7tw53Lp1CyYmJhg9ejQmTZqE119/XdsjUBZotUg+Kjs7G0FBQTh16hTX/ZKnpycGDRqEgQMHwsfHB8bGxo0RpUWorq5GbGwsLl26hEuXLuGPP/5AWVkZPD09uYPU46PntVS5ubm4cOECzp07h/Pnz0OhUMDW1pbbL318fODm5tbkhkttilQqFSIiIhAWFoarV68iLCwMpaWl6Ny5M4YNG4ahQ4fCx8cHYrG4sSI1XpF8lEqlQmhoKM6dO4dLly7h1q1bEAqF8PLywsCBA9GnTx94enrCxsamsaM1WaWlpYiJiUFERAQuXbqEsLAwFBYWwsLCAgMHDsRrr72GkSNHok2bNnxH1WkajQZRUVEIDg5GWFgYrl+/DqVSiVatWqFv377w9vaGp6cnevTowfXiz7wcIsKdO3e4/fbq1auIjIxEVVUV7Ozs0K9fPwwYMADDhg2DnZ0dXzH5KZKPy8rK4lo8ly9fRlJSEogIbdu2haenJzd16dKl3sHDW5qioiIkJCQgKioKkZGRiIyMRGJiIqqrq2FpaYl+/fph4MCBGDRoEGsBvaKaFvmVK1dw5coV/PXXX8jIyADwsNft7t27o0ePHujevTu6dOmCdu3aQSgU8pxa95SUlCApKQlxcXGIjY1FTEwMbty4geLiYujr68PNzQ0+Pj7w9vZGv379njqcRSPTjSL5uKKiIu7NXzPdv38fAGBqaopOnTrBzc2N+9fJyQkODg7cuBvNQXV1NTIzM3Hnzh0kJiYiISEBCQkJuHXrFv755x8AgFwur3UQ8fT0hIODA8/Jm7/s7GzExsZyb/aYmBjcvn0bGo0GIpEI7du3R6dOneDi4sJNjo6OsLGxadYFVKVSITU1Fffv30diYiKSkpKQnJyM5ORkbuAwiUSCbt261Tq4dO3aVWcHHoSuFsn65OXl4ebNm7h16xZXLG7dusVtfACwtraGg4MDN9nb28PGxgaWlpawsLCAlZUVzMzMePwrHiorK4NCoUBmZiYUCgUUCgXS0tKQmprKTenp6dxwEjUHhs6dO8PV1ZU7QLRr1461EnVETUspOTm5ToGoGTFQX18fNjY2cHBwgK2tLezs7GBnZwcLCwtuHzU3N4e5uXl9nb/yprS0FAqFAtnZ2cjNzUVubi4yMzPx4MEDpKWlIS0tDQ8ePEBeXh73O1ZWVnB1deUOEh07dkTHjh3RoUMH6Ovr8/jXvLCmUySfpKioCHfv3uWKy/3793H//n2kpqbiwYMHdUZ9NDAwgIWFBSwsLGBiYgJjY2MYGxvDzMwMxsbGMDIy4npif7Sg6unpQSaTcT+rVCqUl5dzP5eWlqKyshJVVVUoKSlBQUEBSkpKUFpaipKSEhQWFqKwsBBZWVl1hl01MjKCnZ1drQLv4OAAR0dHtGvXjl1HbOL++ecf7sD3eGGp2UcfH5tbJpPB1NQUlpaWkMvlkEqlkEqlkMlkMDY2hlQq5T7oNDExqdVClUqltT7YUCqVUKvV3M9lZWWoqKgAEaGwsBClpaUoKyuDUqlEcXExysrKUFJSwhVElUpVK5tEIoGVlRW3z9ra2sLW1hb29vawt7eHg4MD5HK5NjYlH5p+kXwWtVrNtdaysrKQk5OD3NxcKBQKKJVKKJVKrojV/F+lUqG6urrWoGE1xa+GWCyudYpgaGgIiUQCoVAIExMTyOVyrgAbGxtDLpdDJpPB2toaSUlJWLNmDXbv3o3x48fr8qkG00hqClLNdPToURw5cgSzZs0CEXGFrKioCEqlEmVlZdzBtrCwEI++jR8vio8XzUf3XblcDiMjI0ilUpiamsLU1JQrwDWt2pqpprXbwoZzaf5FUlf5+/vjwoULiI2NZZ/iM7XcvXsX7u7uWLhwIb755hu+47R0rEjypaSkhLvNKTQ0tKldp2G0RKPRYNCgQSgqKkJERIROXZtsoQrqjLvNNA5jY2McOHAA165dw3fffcd3HEZHrFmzBuHh4di7dy8rkDqCtSR59sMPP2Dx4sW4dOkSvL29+Y7D8CghIQEeHh5YunQpPvnkE77jMA+x022+ERHGjh2L6OhoxMTEsG9xtFBqtRp9+vSBSCTivkvO6AR2us03gUCAXbt2QU9PD9OnTwc7ZrVMS5cuRUJCAnbv3s0KpI5hRVIHmJmZYd++fTh37hw2b97MdxymkUVFRWH16tVYs2YNXFxc+I7DPIadbuuQZcuWYeXKlbh27Rp69OjBdxymEdT0hmVtbY2QkBD2DSrdw65J6hKNRoPXX38dqampiI6OhomJCd+RGC1bsGAB9uzZg7i4OF3q1IH5/9g1SV2ip6eHAwcOQKlUYv78+XzHYbQsLCwMP/30EzZu3MgKpA5jLUkddO7cOYwYMQJ79uyBv78/33EYLSguLuZ6wzl58iTfcZgnYy1JXTRs2DB88MEHmDNnDhITE/mOw2jBBx98gNLSUmzbto3vKMwzsJakjqqqqkL//v1RWlqKiIiIZtVXZksXFBSEUaNG4ejRo3jrrbf4jsM8HfvgRpfdvXsXPXv2xLRp0/Djjz/yHYdpAHl5eejSpQuGDBmCvXv38h2HeTZ2uq3L2rdvj59//hkbN25k162aiblz50JfX58d9JoQ1pJsAt59912cOHECMTExbHiGJuzQoUPw8/PDmTNnMGzYML7jMM+HnW43BeXl5ejVqxdkMhkuXrzYrMdJaa4yMjLQtWtXTJo0CZs2beI7DvP82Ol2U2BoaIiDBw8iKioK//3vf/mOw7yEgIAAyOVy1i1eE8SKZBPRuXNnrFu3Dt9++y1CQ0P5jsO8gO3btyM4OBi7du3ixqVhmg52ut3ETJ48GRcvXkRsbCysra35jsM8w7179+Du7o65c+di1apVfMdhXhy7JtnUFBUVoUePHujYsSPOnj3LOkTQYdXV1Rg0aBAKCgoQGRlZazAupslg1ySbGplMhiNHjuDixYtYu3Yt33GYp1i9ejUiIiKwf/9+ViCbMFYkmyAvLy988803+Oyzz3Dt2jW+4zD1iI6OxtKlS/Htt9/C3d2d7zjMK2Cn200UEeHNN99EXFwcYmNjYWZmxnck5v+UlZXBw8MDlpaW+OOPP6Cnx9oiTRg73W6qBAIBdu7cCbVajVmzZvEdh3nEhx9+iKysLOzbt48VyGaAvYJNmIWFBQ4ePIhff/0VP//8M99xmgSNRoP169ejb9++Wln+uXPnsH37dmzdurVF9hGp7e3LC2KavM8//5wMDQ0pNjaW7yg6LTk5mby9vQkAubu7N/jys7OzycrKiqZPn97gy24KtL19eZLPWpLNwNKlS+Hp6YnJkyejrKyMlwwqlUrrrYdXWceNGzfw6aefYs6cOejevXsDJ3t4jXjmzJmQSqVa6byipW9fPrEi2QwIhUIcOnQI2dnZWLhwIS8ZfvnlF+Tk5OjsOtzd3XH8+HH4+flp5XacTZs24ezZs9i9ezdMTU0bfPktffvyiu+2LNNwgoKCSCAQ0IEDB545r0ajobVr15KrqysZGBiQXC6n0aNH061bt7h55s2bRyKRiKysrLjH5s6dS1KplACQQqEgIqIFCxaQgYEBASAA1KFDB/rxxx9JLBaThYUFzZ49m6ytrUksFlOfPn3o+vXrDbKOl9WrV68GPR1MSEggiURCX3/9NfcY277N53SbFclm5v333ydjY2NKSkp66nxfffUVGRgY0L59+6iwsJDi4uKoZ8+eZG5uTllZWdx8fn5+td5gRERr1qyp9QYjIho/fnydN9bs2bPJyMiIEhISqLy8nG7evEleXl5kYmJCaWlpDbKOl9GQb+LKykry8vIiT09Pqqys5B5n27f5FEl2ut3MfP/993B2doafnx8qKyvrnUelUmHdunUYN24cpkyZAplMhq5du2Lr1q3Izc3F9u3bGyyPUChEp06dIBaL4ebmhs2bN0OpVGLXrl0Ntg4+ff7557h16xYOHToEkUgEgG3f5oYVyWZGLBYjMDAQSUlJ+Pzzz+ud5+bNmygpKYGnp2etx728vGBgYIDw8HCt5fP09IRUKm0WA5yFhIRg7dq1+PHHH+Hk5MQ9zrZv88KKZDPk5OSE7du3Y+3atTh9+nSd5wsLCwGg3m675HI5lEqlVvOJxWIoFAqtrkPbFAoFpk2bhnHjxuGdd96p9Rzbvs0LK5LN1KRJk+Dv74+ZM2ciIyOj1nNyuRwA6n2zFhYWwtbWVmu5qqqqtL4ObSMivPPOOxCJRPWeOrPt27ywItmMbd68Ga1bt8bkyZNRXV3NPd6lSxcYGxsjMjKy1vzh4eGorKyEh4cH95hQKERVVVWDZbp06RKICL1799baOrRt3bp1CA4OxuHDh+v9zjzbvs0LK5LNmJGREQIDAxEREYEVK1ZwjxsaGuKjjz7CiRMnsH//fhQXFyM+Ph5z5syBjY0NZs+ezc3r5OSE/Px8nDx5ElVVVVAoFEhNTa2zrlatWiEjIwP379+HUqnk3pQajQYFBQVQq9WIi4vDwoULYW9vj+nTpzfYOhpTVFQUPvvsM3zzzTfo06dPvfOw7dvM8PzxOtMINmzYQHp6evT7779zj2k0GlqzZg05OzuTSCQiMzMzGjt2bJ1bh/Ly8mjQoEFkaGhI7dq1o3nz5tHixYsJADk5OXG3mkRHR5ODgwNJJBLy8fGhrKwsmj17NolEImrbti0JhUIyNTWlMWPG0J07dxpsHc/r2rVr5O3tTTY2Nty9gNbW1tS3b1+6fPnycy1DqVRSx44dacCAAaRWq586L9u+L759dVQ+6yqthRg7diwiIyMRExMDc3PzRlnne++9h6NHjyIvL69R1qdtU6dORXBwMGJjY9GmTRu+4zS77aujWFdpLcXOnTshFAoxbdo0NOZx8dFroU1ZYGAg9u/fj19++UUnCmSN5rJ9dRkrki2EmZkZDh8+jJCQEGzcuJHvOK8sMTERAoHgmdOkSZNeeV137txBQEAAFi5ciFGjRjVAet3XmNtX5/F8vs80sm+++YbEYjFFRUVpdT1Llizhvgvs6OhIR48e1er6tKWyspJ69epFXbt2JZVKxXccTnPZvk0AuybZ0mg0GgwdOhT37t1DVFSUVnqsaU4WLVqEbdu2ISoqCi4uLnzHYRofuybZ0ujp6WHfvn0oKSlhwz48w+nTp7Fu3Tr89NNPrEC2YKwl2UKdP38ew4cPx86dOzFt2jS+4+ic1NRUeHh4YMyYMdixYwffcRj+FLAi2YJ9/PHH2Lx5M/73v/+hU6dOfMfRGeXl5fDx8UFVVRWuXbsGqVTKdySGP6xItmRqtRr9+/eHUqlEREQEJBIJ35F0wqxZs3D48GH873//Q8eOHfmOw/CLXZNsyYRCIQ4fPoyMjAwsXryY7zg64eDBg9ixYwd2797NCiQDgN0n2eLZ29tj27Zt2Lx5M3799Ve+4/AqPj4eAQEBWLRoEcaNG8d3HEZHsNNtBgAwe/ZsBAYGIiYmBo6OjnzHaXQlJSXw8vKCmZkZLl++zPUyzrR47Jok81B5eTl69+4NsViMK1eutKgiQUSYOHEiwsLCEB0drVNfO2R4x65JMg8ZGhri4MGD+Pvvv7F06VK+4zSq9evX49dff8W+fftYgWTqYEWS4bi5ueHHH3/EqlWrEBISwnecRnH9+nUsWbIEy5cvx5AhQ/iOw+ggdrrN1DFlyhSEhIQgNjYWNjY2tZ47cOAARo4cCZlMxlO6F5eVlYWLFy9i8uTJtR7PyclBz5490aNHD5w6dQoCgYCnhIwOY6fbTF1bt26FXC6Hn58fNBoNAKC0tBTTpk3DlClTEBwczHPCF3PkyBH4+fnho48+glqtBvDwO+z+/v4QCoXYvXs3K5DMk/HQqwbTBPzvf/8jAwMDWrVqFcXGxlKHDh1IKBSSnp4evf3223zHeyE9e/YkgUBA+vr6NGDAAFIoFPT555+TWCymyMhIvuMxuo31AsQ82bp167BmzRoUFBSgurqaa4UZGRkhPz8fBgYGPCd8tjt37sDZ2ZnraFgkEsHExASFhYXYsmUL6+SDeRZ2us3Ur6ioCNeuXUN2djYqKiq4Agk8PPUOCwvjMd3zO3jwIIRCIfdzVVUViouLIRAIWtRtTszLY0WSqSMiIgJdu3bFyZMn6x3qQSQS4dSpUzwke3H79u2rM+qfWq1GdXU13nnnHcyaNYuNCsg8FSuSTC0rVqxA3759kZGRUav1+KiqqiocO3askZO9uNjYWFGWhZQAABUuSURBVKSkpDx1np07d8LX1xcKhaKRUjFNDSuSTC2dOnWCqakp9PSevmtkZGTgxo0bjZTq5Rw+fPiZ100FAgFiYmLwxx9/NFIqpqlhRZKpZezYsUhKSsLw4cMB4Im3xhgYGOj0KTcRYd++faisrKz3+ZqDwOuvv46EhARMnDixMeMxTQgrkkwdFhYWOHnyJAIDA2FiYlLvBxyVlZU6fcodFhaGjIyMep8TCoUwNzfHsWPHcObMGdjZ2TVyOqYpYUWSeaIJEyYgMTERgwcPrvf0Oz4+Hg8ePOAh2bMdOnSozqm2UCiEnp4e5syZg9u3b2P8+PE8pWOaElYkmaeysbHBuXPnsGXLFkgkklqtSn19fZw+fZrHdPVTq9U4cuRIrVNtPT09uLq64vr169iwYQNMTEx4TMg0JaxIMs8kEAgwa9Ys3Lx5E15eXtDX1wfw8Kt9J06c4DldXefPn0dBQQGAh7cricVirFixArGxsfDy8uI5HdPUsG/cMC+kuroaq1evxldffYXq6moIhULk5eXVaZkVFhairKwMZWVlKCoqAgCucNUoLy+HSqWq9ZhEIoGhoWGtx8zMzAAAMpkMUqkUUqkUcrn8iRmnTJmCAwcOAABGjhyJLVu2wNbW9uX+YKalY53uMk9XVVWFzMxMpKWlQaFQcFNSUhJOnTqFoqIiODk5QaPRoKSkBKWlpSgtLW2UbEZGRpBKpTAxMYG5uTlat24NuVyOY8eOQSwWw9/fH0OGDIGFhQXs7e1hY2PDvmXDvChWJFs6tVqN+/fvIyUlBcnJyUhNTcWDBw/w4MEDpKWlISsrC9XV1dz8MpkMlpaWMDc3h5mZGdLT00FE8PPzg6mpKSQSCYyNjblWn0Qi4VqCJiYmtb4iKBQK67RAS0pKan0DRq1WQ6lUAnjYElWpVFzrtKSkBCqVCkqlErm5ucjNzeU+TDI2NkZubi7XigUeXpe0traGg4MDbG1tYWtrCwcHBzg7O8PFxQWOjo618jEMWJFsOVQqFf7++2/ExMQgKSkJycnJSE5Oxr1797iiZGVlBUdHx1oFxNbWFm3btoWDgwMsLS3rbYklJibC1dW1sf+kepWWlsLIyIj7uaqqCjk5OUhLS+OK/6MHgvv37yM7OxvAw+uX7dq1g4uLC1xcXNCxY0f06NEDXbp0YcPttlysSDZHRUVFiIiIQExMDG7cuIHY2FgkJSWhuroaJiYmcHV15VpPLi4u3P9NTU35js6L4uJiriWdkpKCpKQkpKSkIDExEUqlEvr6+ujYsSO6d+8Od3d39OjRA//617+aVMfDzEtjRbI5yMjIwNWrV3HlyhVcvXoVMTEx0Gg0MDMzg5ubGzw8PLipU6dOz/zKIfP/ZWRkICoqipsSEhJw9+5dAED79u3h7e0NHx8feHt7w83NjXXe2/ywItkUKRQKXLhwAcHBwfj999+RmZkJsVgMDw8P9O3bF97e3ujTpw+srKz4jtosZWdn4/r167hy5Qr++usvREVFoaKiAjY2NvD19cXQoUMxZMgQWFpa8h2VeXWsSDYFRITw8HCcOXMGwcHBiI6OhlAohLe3N15//XX069cPnp6eEIvFfEdtkSoqKhAZGYkrV67gwoULuHLlCtRqNXr27Ik33ngDI0aMQO/evVkrs2liRVKX3bx5E0ePHsX+/ftx584dtGvXDkOGDMFrr72G119/nV0T01FlZWX466+/EBoaitOnTyMhIQG2trYYN24cJkyYAG9vb1Ywmw5WJHXNvXv38PPPP+PQoUO4f/8+nJ2dMXHiREycOBHdunXjOx7zEuLj4xEYGIjAwEAkJyfD0dERkyZNQkBAANq3b893PObpWJHUBRqNBufOncPmzZsRHBwMGxsb+Pv7Y+LEiejRowff8ZgGFBMTg8DAQOzbtw+ZmZkYOnQo5syZg+HDh7MP1HQTK5J8qqiowI4dO/D9998jNTUVvr6+mDNnDt588012U3Mzp1arcfr0aWzZsgWhoaFwcHDARx99hICAAHZtWbewIsmHyspK7Ny5EytWrIBCoUBAQADef/99uLi48B2N4UFycjJ++ukn/Pzzz7CwsMCSJUswc+bMJjEaZQvAimRj+/XXX/HBBx8gKysLAQEB+PTTT9G2bVu+YzE6ICMjA6tWrcL27dthbW2N9evXY+zYsXzHaunYkLKNJSMjA+PHj8f48eMxcOBApKSkYOPGjaxAMpw2bdpgw4YNuH37NgYNGoTx48dj3LhxT+xhnWkcrEg2gkOHDqFz586IjY3FhQsXsHv3bjZkAPNEtra22LVrF0JDQxEXFwc3NzccOnSI71gtFiuSWkRE+PLLL+Hn5wd/f3/Ex8fjtdde4zsW00QMHjwY8fHxmD59Ovz8/PDll1/WOw46o2XEaEV5eTm99dZbZGBgQDt27GiUdQYEBJBcLicAJBKJyMvL64V+/8yZM2RqakqnTp165SwHDhwgANSnT59XXhZDtHPnTjIwMKAJEyZQeXk533FaknzWktSC6upqTJ48GSEhIbhw4QJmzpzZKOvdvn07QkJCAACzZs1CRETEC/0+NWAr5eDBg+jQoQOuXbuG27dvN9hyW6oZM2YgJCQEISEh8PPzq9XHJ6NdrEhqwTfffIOzZ8/i9OnTGDBgAN9xntuIESNQVFSEUaNGvdJy8vLykJCQgGXLlgEA9u7d2xDxWrz+/fvj9OnTOHPmDP773//yHafFYEWygUVHR2P58uVYu3Yt+v2/9u41psmzjQP4v3IoLVBOLYLQMgiHMBWQU+SUQLKBbtMhE4YEdYQNZCabmYuYsTizSYybGZkMlmlcZlBO7gDih+GccZPhHAwQORWUUzkNqlAoZVThej8Ynnd9cb6bwxbh/iX9wNPb+/5D8Ap9DvcVEWHoOAZRWlqK559/Hps3b4aZmRkKCgrYubQFEh4ejpycHGRnZ+O3334zdJxlgRXJBbZv3z6EhIQgIyPD0FE4RISPP/4Y3t7e4PP5sLGxQWxsLNra2rgxVVVVkMlk4PF4+PTTTwEA+fn5XB+Z8vJybNy4ESKRCM7Ozg+92lpYWIi4uDhYWloiOjoa3d3duHLlyrxx/2T+H3/8EcHBwRAKhRCJRFi7di3Gx8cRGBgIHo8HHo8HHx8fKBSKB2Y6ePAgbG1tYWZmhkOHDgG4f1rkwIEDkMlkEAgE8PHxQUlJCQDgww8/5PrnDA8PY+/evXBycoJcLv/LLPqSnp6OkJAQ7Nu3T29rLmsGPim6pLS1tRGPx6PKykqDZaipqSEAtHv3bu7YgQMHyNTUlAoKCmhsbIwaGxvJ39+fxGIxDQ0NceMUCgUBoNzcXO5YVlYWAaAffviBVCoVDQ8PU0REBJmbm5NWq523fk9PD0kkErp37x4RERUUFBAASk1NfWDevzO/Wq0mkUhER44coampKRoaGqK4uDgaGRkhIqKwsDCSSqU0OzvLzVtRUUGenp46ax07doyys7O5r99++23i8/n01Vdf0ejoKL3zzju0YsUKqqmp0cn25ptvUm5uLsXFxVFtbe1Ds+hLZWUlAaDW1la9rrsM3WFFcgF98sknZGtrSzMzMwbL8L9FUqPRkIWFBSUmJuqM+/XXXwkAvf/++9yxhxXJqakp7lheXh4BoJs3b85b//Dhw5SSksJ9rVKpiM/nk0gkIo1GM2/835m/qamJAND58+cf+D2fOHGCANClS5e4Y1u3biUAVF1dzR0LCwujnp4eIiKampoioVCo83PRaDTE5/Pp9ddf/8ts/y+LvszOzpJYLKacnByD5lgG2NXthdTa2go/P79FtZtLc3Mz1Go1AgMDdY4HBQXB1NQU165d+8dzzj1T/OeuhnPmPmrPEYlEiI6Oxvj4OMrLyx9pfjc3N9jb2yM5ORkHDx5Ed3e3zviXX34ZQqGQu0A0OjqKW7dugc/nc8e6u7thamoKmUwGAJDL5dBoNFizZg03j0AggIODg85piP/1/7LoC4/Hg5+fH1paWgyy/nKyeP43LwFqtVqnU58hzW3qOjY2BgCwsLCYN8ba2ppr17oQmpqacOPGDWzatIk7T8jj8VBRUQHg0a9yCwQCXLp0CeHh4cjOzoabmxsSExMxNTUF4H6r2ri4OHz99dfQaDQoKipCamoqNm3ahJKSEkxPT6OoqAjJycncnHO9wd99912drD09PdBoNI+cRZ8sLS2hVqv1vu5yw4rkApJIJBgaGjJ0DACAnZ0dgPuFEMADi+HY2BicnZ0XbM0zZ85g27ZtICKd1507dyAQCHDhwoVH/vmsXr0aFRUVGBgYQGZmJkpKSnD06FHu/ZSUFExMTODbb79FUVEREhMTkZKSgtHRUZw/fx5lZWXYunUrN14ikQAAcnJy5uW9evXqv8qiL4ODg6yPjh6wIrmAgoOD0dDQoNcrnQCwa9cu9Pf3A7i/RyUAbhfzNWvWwMLCArW1tTr/5tq1a9BqtQgICFiQDESE4uJi7N69e957NjY2iI+Px8zMDAoLC//x3AMDA9zHSolEgsOHD8Pf31/no2ZUVBRcXFxw6NAh2Nvbw87ODjExMXB0dMR7770HV1dXnZa5UqkUZmZmaGhoWPAs+jA+Po66ujoEBwfrdd3liBXJBbRx40aYmpri1KlTel+7sLAQarUaxcXF8PDwwAsvvAAAMDMzw969e/HNN9/g9OnTGB8fx40bN5CRkQFHR0ekp6cvyPrV1dUQiUQICwt74Ptzt0Q9ykfugYEB7Nq1C21tbdBqtaivr0dPTw/Wr1/PjeHxeNi5cyfa2tqwc+dOAICRkRG2b9+O5uZmbN++XWdOMzMzpKSkoKioCPn5+RgfH8fMzAz6+vowODj4r7Low6lTp2BiYoLnnntOr+suSwa7ZrRE7dmzh+zt7Wl0dFRvax49epSsra2Jz+fThg0bqLOzU+f92dlZ+uijj8jDw4NMTEzIxsaGtmzZQnK5nBuTm5tLDg4OBICEQiFt3ryZ8vLySCgUEgDy8PCgW7du0fHjx0kkEhEAcnFxofb2dkpNTSVzc3MyNjYmX19fqqur01n/gw8+IEdHRwJAAMjJyYny8vL+9vzd3d0UGhpKNjY2ZGRkRKtWraKsrCzuNqM5nZ2dZG9vr3NrUmtrK9nb29Pdu3fn/dymp6cpMzOTZDIZGRsbk0QioZdeeomam5vpyJEjJBAICABJpVIqKCggIvrbWR6nsbExWrlyJe3Zs0dvay5jd9imuwtsdHQUq1evRlhYGEpLS1lXPGZBERESEhJQVVWFlpYW2NjYGDrSUsc23V1oNjY2OHPmDMrKypCVlWXoOMwSk5WVhbKyMhQWFrICqSes29RjEBUVhZMnT+KVV16BWq1GTk4OjIyMDB2LeYLNzMzgrbfeQm5uLr788ktERUUZOtKywYrkY7Jjxw6Ym5tjx44dkMvlKC0thZWVlaFjMU8gtVrNbb13+vRpJCUlGTrSssLOST5mtbW1ePHFF2Fubo4TJ048UVunMYb3008/4bXXXsPExATKy8sRFBRk6EjLDTsn+bgFBgaipqYG3t7eiIqKQlpaGvcUDMP8lbGxMaSnpyMyMhJeXl6oqalhBdJAWJHUg1WrVqG8vBwlJSWoqKiAt7c3jh07hj/++MPQ0ZhFZnp6Grm5ufD29sa5c+dQXFyMc+fOsa6aBsSKpB7Fx8ejpaUFSUlJ2L9/P9zd3ZGXl8c9JcMsX1qtFvn5+XB3d0dmZia2bduGlpYWJCQkGDrassfOSRrI4OAg14jezs4O6enpePXVV+Ho6GjoaIweDQ4O4uTJk/j888+hVCqRlpaG/fv3s9+DxWOUFUkD6+/vx7Fjx/DFF19ApVIhNjYWGRkZiIyMZDeiL1FEhMuXL+Ozzz5DWVkZrKyskJKSgjfeeGNBNxxhFgQrkouFVqtFeXk5jh8/josXL0IqlWLLli2Ij49HWFgYK5hLQHNzM86ePYvCwkJ0dHQgICAAaWlpSE5OhlAoNHQ85sFYkVyMGhsbUVRUhJKSEnR1dcHd3R0JCQmIjY1FQEDAotrUl/lrs7OzqKurQ1lZGUpKSnDz5k24uroiISEBSUlJ3E5NzKLGiuRiV1NTg9LSUpw9exY9PT0Qi8V49tlnsWHDBkRHR8PBwcHQEZk/GRoawoULF1BZWYnvv/8eIyMjkMlkiI+PR0JCAtva7MnDiuSTpKmpCd999x0qKytRVVWF6elp+Pj4ICIiAiEhIQgPD+faEzD6oVAoUFVVherqaly5cgWNjY0wNTVFREQEYmJiEBMTg7Vr1xo6JvPoWJF8Umk0Gly+fBkXL15EdXU16urqcPfuXTg7OyMsLAyhoaFYt24dfHx82OOQC0SlUqGxsRH19fW4evUqqqqq0NfXBxMTE/j7+yM0NBTPPPMMIiMj2TnGpYMVyaVCo9GgpqYGP//8M6qrq/HLL7/g9u3b4PF4cHV1hZ+fH3x9feHn54enn34aTz31FIyN2aP7D3Lv3j10d3ejpaUFDQ0NuH79OhoaGtDV1QUigq2tLdavX4/Q0FCEh4cjKCiIFcWlixXJpay3txfXr1/nXvX19ejs7AQRwdTUFK6urvDy8oKnpyc8PDzg6ekJFxcXODk5cR0LlyqtVouBgQF0d3ejo6MD7e3taG9vh1wuR1dXF7RaLXg8Htzc3LBu3Tr4+vpyL3ZKY1lhRXK5mZiYgFwuR0dHB+RyOVccOjo6uN48PB4PDg4OcHZ2hrOzM6RSKaRSKVauXAmxWAyxWAx7e3uIxeJF0x1yzuTkJJRKJYaHh6FUKqFUKvH7779DoVBAoVCgv78fCoUCQ0NDmPvVt7S0hKenJ/fy8vKCh4cHvLy8YGlpaeDviDEwViSZ/xoaGkJvby/6+vqgUCjQ29vLFZXe3l6MjIzMe4RSIBDAzs4OYrEYFhYWEAgEsLa2hrm5OYRCISwtLWFpaQljY2MYGRnpNOMC7ndznLsHlIjmbf4x13tmZmYG4+PjmJiYgEajweTkJFQqFTQaDdRqNW7fvg2lUjmvtSufz4dEIoFMJuOKvkwmg1QqhZOTE1xcXNgdAszDsCLJ/DMTExMYGRnByMgIlEolV5yUSiUmJyeh0WigUqmgVqu5AqZSqTA7O4vp6Wmdntazs7NQqVQ681tZWencByoUCsHn87FixQpYWVnBwsICQqEQFhYWsLKyglAohLm5OfcX7lzBlkgkkEgk7C9B5t9iRZJhGOYh2H6SDMMwD8OKJMMwzEOwIskwDPMQxgDOGjoEwzDMIjX5H/3a+KhCfpeKAAAAAElFTkSuQmCC",
|
||
"text/plain": [
|
||
"<IPython.core.display.Image object>"
|
||
]
|
||
},
|
||
"execution_count": 18,
|
||
"metadata": {},
|
||
"output_type": "execute_result"
|
||
}
|
||
],
|
||
"source": [
|
||
"# Let's have a look on the structure of the combined Table an Text QA pipeline.\n",
|
||
"from IPython import display\n",
|
||
"\n",
|
||
"text_table_qa_pipeline.draw()\n",
|
||
"display.Image(\"pipeline.png\")"
|
||
]
|
||
},
|
||
{
|
||
"cell_type": "code",
|
||
"execution_count": null,
|
||
"metadata": {
|
||
"id": "strPNduPoBLe"
|
||
},
|
||
"outputs": [],
|
||
"source": [
|
||
"# Example query whose answer resides in a text passage\n",
|
||
"predictions = text_table_qa_pipeline.run(query=\"Who was Thomas Alva Edison?\")"
|
||
]
|
||
},
|
||
{
|
||
"cell_type": "code",
|
||
"execution_count": 22,
|
||
"metadata": {
|
||
"colab": {
|
||
"base_uri": "https://localhost:8080/"
|
||
},
|
||
"id": "9YiK75tSoOGA",
|
||
"outputId": "bd52f841-3846-441f-dd6f-53b02111691e"
|
||
},
|
||
"outputs": [
|
||
{
|
||
"name": "stdout",
|
||
"output_type": "stream",
|
||
"text": [
|
||
"\n",
|
||
"Query: Who was Thomas Alva Edison?\n",
|
||
"Answers:\n",
|
||
"[ { 'answer': 'American inventor and businessman',\n",
|
||
" 'context': 'mas Alva Edison (February 11, 1847October 18, 1931) was an '\n",
|
||
" 'American inventor and businessman, who has been described '\n",
|
||
" \"as America's greatest inventor. H\"},\n",
|
||
" { 'answer': 'John Béchervaise , OAM , MBE',\n",
|
||
" 'context': Name \\\n",
|
||
"0 Amanda Barnard \n",
|
||
"1 Martin G. Bean \n",
|
||
"2 Gordon S. Brown \n",
|
||
"3 John Béchervaise , OAM , MBE \n",
|
||
"4 Megan Clark , AC \n",
|
||
"5 J. Donald R. de Raadt \n",
|
||
"6 Graham Dorrington \n",
|
||
"7 Dennis Gibson , AO \n",
|
||
"8 Ranulph Glanville \n",
|
||
"9 Alfred Gottschalk \n",
|
||
"10 Ann Henderson-Sellers \n",
|
||
"11 Arthur R. Hogg \n",
|
||
"12 Kourosh Kalantar-zadeh \n",
|
||
"13 Richard Kaner \n",
|
||
"14 Lakshmi Kantam \n",
|
||
"15 William Kernot \n",
|
||
"16 Sir Albert Kitson \n",
|
||
"17 David Malin \n",
|
||
"18 Henry Millicer , AM \n",
|
||
"19 Luca Marmorini \n",
|
||
"\n",
|
||
" Association with RMIT \\\n",
|
||
"0 B Sci ( AppPhysics ) ( Hon ) , PhD \n",
|
||
"1 current Vice-Chancellor \n",
|
||
"2 Dip Civil Eng , Elec Eng , Mech Eng [ WMC ] \n",
|
||
"3 science classes \n",
|
||
"4 DAppSci ( honoris causa ) , former faculty \n",
|
||
"5 FRMIT \n",
|
||
"6 faculty \n",
|
||
"7 former Chancellor \n",
|
||
"8 former faculty \n",
|
||
"9 former faculty \n",
|
||
"10 former Deputy Vice-Chancellor \n",
|
||
"11 science classes \n",
|
||
"12 attended ( PhD ) and also former faculty \n",
|
||
"13 faculty \n",
|
||
"14 faculty \n",
|
||
"15 former President [ WMC ] \n",
|
||
"16 geology , mining , surveying classes [ WMC ] \n",
|
||
"17 D AppSci ( honoris causa ) \n",
|
||
"18 D Eng ( honoris causa ) ; former faculty \n",
|
||
"19 faculty \n",
|
||
"\n",
|
||
" Notability \n",
|
||
"0 nanotechnologist and theoretical physicist ; Head of the CSIRO Nanoscience L... \n",
|
||
"1 technology executive ; former Global Director of Microsoft and former Vice-C... \n",
|
||
"2 cyberneticist ; Emeritus Professor of Electrical Engineering at MIT \n",
|
||
"3 Antarctic explorer and author \n",
|
||
"4 scientist ; current CEO of the CSIRO \n",
|
||
"5 Emeritus Professor of Informatics and System Science at Luleå University of ... \n",
|
||
"6 aeronautical engineer ; subject of the 2004 documentary The White Diamond by... \n",
|
||
"7 mathematician \n",
|
||
"8 cybernetics theoretician \n",
|
||
"9 biochemist and glycoprotein researcher \n",
|
||
"10 former Director of the UN Climate Programme \n",
|
||
"11 astronomer and physicist \n",
|
||
"12 Materials scientist , electronic engineer and Australian Research Council ( ... \n",
|
||
"13 chemist and nanotechnologist ; recipient of the Tolman Award ( 2008 ) \n",
|
||
"14 chemist ; Adjunct Professor and Director of the IICT -RMIT Research Centre \n",
|
||
"15 Old Kernot Engineering School at RMIT named in his honour \n",
|
||
"16 geologist ; recipient of the Lyell Medal ( 1927 ) \n",
|
||
"17 astronomer \n",
|
||
"18 aircraft designer \n",
|
||
"19 head of the engine and electronics department for the Ferrari F1 team },\n",
|
||
" { 'answer': 'Ann Henderson-Sellers',\n",
|
||
" 'context': Name \\\n",
|
||
"0 Amanda Barnard \n",
|
||
"1 Martin G. Bean \n",
|
||
"2 Gordon S. Brown \n",
|
||
"3 John Béchervaise , OAM , MBE \n",
|
||
"4 Megan Clark , AC \n",
|
||
"5 J. Donald R. de Raadt \n",
|
||
"6 Graham Dorrington \n",
|
||
"7 Dennis Gibson , AO \n",
|
||
"8 Ranulph Glanville \n",
|
||
"9 Alfred Gottschalk \n",
|
||
"10 Ann Henderson-Sellers \n",
|
||
"11 Arthur R. Hogg \n",
|
||
"12 Kourosh Kalantar-zadeh \n",
|
||
"13 Richard Kaner \n",
|
||
"14 Lakshmi Kantam \n",
|
||
"15 William Kernot \n",
|
||
"16 Sir Albert Kitson \n",
|
||
"17 David Malin \n",
|
||
"18 Henry Millicer , AM \n",
|
||
"19 Luca Marmorini \n",
|
||
"\n",
|
||
" Association with RMIT \\\n",
|
||
"0 B Sci ( AppPhysics ) ( Hon ) , PhD \n",
|
||
"1 current Vice-Chancellor \n",
|
||
"2 Dip Civil Eng , Elec Eng , Mech Eng [ WMC ] \n",
|
||
"3 science classes \n",
|
||
"4 DAppSci ( honoris causa ) , former faculty \n",
|
||
"5 FRMIT \n",
|
||
"6 faculty \n",
|
||
"7 former Chancellor \n",
|
||
"8 former faculty \n",
|
||
"9 former faculty \n",
|
||
"10 former Deputy Vice-Chancellor \n",
|
||
"11 science classes \n",
|
||
"12 attended ( PhD ) and also former faculty \n",
|
||
"13 faculty \n",
|
||
"14 faculty \n",
|
||
"15 former President [ WMC ] \n",
|
||
"16 geology , mining , surveying classes [ WMC ] \n",
|
||
"17 D AppSci ( honoris causa ) \n",
|
||
"18 D Eng ( honoris causa ) ; former faculty \n",
|
||
"19 faculty \n",
|
||
"\n",
|
||
" Notability \n",
|
||
"0 nanotechnologist and theoretical physicist ; Head of the CSIRO Nanoscience L... \n",
|
||
"1 technology executive ; former Global Director of Microsoft and former Vice-C... \n",
|
||
"2 cyberneticist ; Emeritus Professor of Electrical Engineering at MIT \n",
|
||
"3 Antarctic explorer and author \n",
|
||
"4 scientist ; current CEO of the CSIRO \n",
|
||
"5 Emeritus Professor of Informatics and System Science at Luleå University of ... \n",
|
||
"6 aeronautical engineer ; subject of the 2004 documentary The White Diamond by... \n",
|
||
"7 mathematician \n",
|
||
"8 cybernetics theoretician \n",
|
||
"9 biochemist and glycoprotein researcher \n",
|
||
"10 former Director of the UN Climate Programme \n",
|
||
"11 astronomer and physicist \n",
|
||
"12 Materials scientist , electronic engineer and Australian Research Council ( ... \n",
|
||
"13 chemist and nanotechnologist ; recipient of the Tolman Award ( 2008 ) \n",
|
||
"14 chemist ; Adjunct Professor and Director of the IICT -RMIT Research Centre \n",
|
||
"15 Old Kernot Engineering School at RMIT named in his honour \n",
|
||
"16 geologist ; recipient of the Lyell Medal ( 1927 ) \n",
|
||
"17 astronomer \n",
|
||
"18 aircraft designer \n",
|
||
"19 head of the engine and electronics department for the Ferrari F1 team },\n",
|
||
" { 'answer': 'nanotechnologist and theoretical physicist ; Head of the '\n",
|
||
" 'CSIRO Nanoscience Laboratory',\n",
|
||
" 'context': Name \\\n",
|
||
"0 Amanda Barnard \n",
|
||
"1 Martin G. Bean \n",
|
||
"2 Gordon S. Brown \n",
|
||
"3 John Béchervaise , OAM , MBE \n",
|
||
"4 Megan Clark , AC \n",
|
||
"5 J. Donald R. de Raadt \n",
|
||
"6 Graham Dorrington \n",
|
||
"7 Dennis Gibson , AO \n",
|
||
"8 Ranulph Glanville \n",
|
||
"9 Alfred Gottschalk \n",
|
||
"10 Ann Henderson-Sellers \n",
|
||
"11 Arthur R. Hogg \n",
|
||
"12 Kourosh Kalantar-zadeh \n",
|
||
"13 Richard Kaner \n",
|
||
"14 Lakshmi Kantam \n",
|
||
"15 William Kernot \n",
|
||
"16 Sir Albert Kitson \n",
|
||
"17 David Malin \n",
|
||
"18 Henry Millicer , AM \n",
|
||
"19 Luca Marmorini \n",
|
||
"\n",
|
||
" Association with RMIT \\\n",
|
||
"0 B Sci ( AppPhysics ) ( Hon ) , PhD \n",
|
||
"1 current Vice-Chancellor \n",
|
||
"2 Dip Civil Eng , Elec Eng , Mech Eng [ WMC ] \n",
|
||
"3 science classes \n",
|
||
"4 DAppSci ( honoris causa ) , former faculty \n",
|
||
"5 FRMIT \n",
|
||
"6 faculty \n",
|
||
"7 former Chancellor \n",
|
||
"8 former faculty \n",
|
||
"9 former faculty \n",
|
||
"10 former Deputy Vice-Chancellor \n",
|
||
"11 science classes \n",
|
||
"12 attended ( PhD ) and also former faculty \n",
|
||
"13 faculty \n",
|
||
"14 faculty \n",
|
||
"15 former President [ WMC ] \n",
|
||
"16 geology , mining , surveying classes [ WMC ] \n",
|
||
"17 D AppSci ( honoris causa ) \n",
|
||
"18 D Eng ( honoris causa ) ; former faculty \n",
|
||
"19 faculty \n",
|
||
"\n",
|
||
" Notability \n",
|
||
"0 nanotechnologist and theoretical physicist ; Head of the CSIRO Nanoscience L... \n",
|
||
"1 technology executive ; former Global Director of Microsoft and former Vice-C... \n",
|
||
"2 cyberneticist ; Emeritus Professor of Electrical Engineering at MIT \n",
|
||
"3 Antarctic explorer and author \n",
|
||
"4 scientist ; current CEO of the CSIRO \n",
|
||
"5 Emeritus Professor of Informatics and System Science at Luleå University of ... \n",
|
||
"6 aeronautical engineer ; subject of the 2004 documentary The White Diamond by... \n",
|
||
"7 mathematician \n",
|
||
"8 cybernetics theoretician \n",
|
||
"9 biochemist and glycoprotein researcher \n",
|
||
"10 former Director of the UN Climate Programme \n",
|
||
"11 astronomer and physicist \n",
|
||
"12 Materials scientist , electronic engineer and Australian Research Council ( ... \n",
|
||
"13 chemist and nanotechnologist ; recipient of the Tolman Award ( 2008 ) \n",
|
||
"14 chemist ; Adjunct Professor and Director of the IICT -RMIT Research Centre \n",
|
||
"15 Old Kernot Engineering School at RMIT named in his honour \n",
|
||
"16 geologist ; recipient of the Lyell Medal ( 1927 ) \n",
|
||
"17 astronomer \n",
|
||
"18 aircraft designer \n",
|
||
"19 head of the engine and electronics department for the Ferrari F1 team },\n",
|
||
" { 'answer': 'Christopher Wren',\n",
|
||
" 'context': Name Years \\\n",
|
||
"0 John Bainbridge 1620 or 1621 - 1643 \n",
|
||
"1 John Greaves 1643-48 \n",
|
||
"2 Seth Ward 1649-60 \n",
|
||
"3 Christopher Wren 1661-73 \n",
|
||
"4 Edward Bernard 1673-91 \n",
|
||
"5 David Gregory 1691-1708 \n",
|
||
"6 John Caswell 1709-12 \n",
|
||
"7 John Keill 1712-21 \n",
|
||
"8 James Bradley 1721-62 \n",
|
||
"9 Thomas Hornsby 1763-1810 \n",
|
||
"10 Abraham Robertson 1810-26 \n",
|
||
"11 Stephen Rigaud 1827-39 \n",
|
||
"12 George Johnson 1839-42 \n",
|
||
"13 William Donkin 1842-69 \n",
|
||
"14 Charles Pritchard 1870-93 \n",
|
||
"15 Herbert Turner 1893-1930 \n",
|
||
"16 Harry Plaskett 1932-60 \n",
|
||
"17 Donald Blackwell 1960-88 \n",
|
||
"18 George Efstathiou 1988-97 \n",
|
||
"19 Joseph Silk 1999-2012 \n",
|
||
"\n",
|
||
" Education \\\n",
|
||
"0 University of Cambridge ( Emmanuel College ) \n",
|
||
"1 Balliol College \n",
|
||
"2 University of Cambridge ( Sidney Sussex College ) \n",
|
||
"3 Wadham College \n",
|
||
"4 St John 's College \n",
|
||
"5 Marischal College and University of Aberdeen , and Leiden University \n",
|
||
"6 Wadham College \n",
|
||
"7 University of Edinburgh and Balliol College \n",
|
||
"8 Balliol College \n",
|
||
"9 Corpus Christi College \n",
|
||
"10 Christ Church \n",
|
||
"11 Exeter College \n",
|
||
"12 The Queen 's College \n",
|
||
"13 St Edmund Hall and University College \n",
|
||
"14 University of Cambridge ( St John 's College ) \n",
|
||
"15 University of Cambridge ( Trinity College ) \n",
|
||
"16 University of Toronto and Imperial College , London \n",
|
||
"17 University of Cambridge ( Sidney Sussex College ) \n",
|
||
"18 Keble College and the University of Durham \n",
|
||
"19 University of Cambridge ( Clare College ) and Harvard University \n",
|
||
"\n",
|
||
" College as professor \\\n",
|
||
"0 Merton College \n",
|
||
"1 Merton College \n",
|
||
"2 Wadham College and Trinity College \n",
|
||
"3 All Souls College \n",
|
||
"4 St John 's College \n",
|
||
"5 Balliol College \n",
|
||
"6 Hart Hall \n",
|
||
"7 Balliol College \n",
|
||
"8 - \n",
|
||
"9 Corpus Christi College \n",
|
||
"10 Christ Church \n",
|
||
"11 - \n",
|
||
"12 The Queen 's College \n",
|
||
"13 University College \n",
|
||
"14 New College \n",
|
||
"15 New College \n",
|
||
"16 New College \n",
|
||
"17 New College \n",
|
||
"18 New College \n",
|
||
"19 New College \n",
|
||
"\n",
|
||
" Notes \n",
|
||
"0 Bainbridge practised as a physician in Leicestershire and London after leavi... \n",
|
||
"1 Greaves began studying astronomical texts in Greek , Arabic and Persian at a... \n",
|
||
"2 When still an undergraduate , Ward impressed John Bainbridge ( the first ast... \n",
|
||
"3 As an undergraduate , Wren joined the circle of mathematicians and natural s... \n",
|
||
"4 Bernard studied Hebrew , Arabic , Syriac and Coptic with Edward Pococke ( La... \n",
|
||
"5 Gregory studied in his native Scotland and befriended the Edinburgh physicia... \n",
|
||
"6 Carswell matriculated at Wadham College , Oxford , when he was 16 years old ... \n",
|
||
"7 Keill studied in Edinburgh with David Gregory and moved to Balliol with him ... \n",
|
||
"8 Bradley was the nephew of James Pound , a leading astronomer who was a colle... \n",
|
||
"9 Hornsby , who had an observatory at Corpus Christi , gained a high reputatio... \n",
|
||
"10 Robertson started studying at Oxford aged 24 , having previously run ( unsuc... \n",
|
||
"11 Rigaud , whose father was the observer at Kew Observatory , made his first r... \n",
|
||
"12 Johnson was a mathematician and priest with little practical knowledge of as... \n",
|
||
"13 Donkin , a talented linguist , mathematician and musician , published papers... \n",
|
||
"14 After leaving Cambridge , Pritchard was headmaster of a grammar school in St... \n",
|
||
"15 Turner was second wrangler ( achieved the second-highest marks in the Cambri... \n",
|
||
"16 Plaskett , a solar physicist , was the son of the Canadian astronomer John S... \n",
|
||
"17 Blackwell was assistant director of the Solar Physics Observatory at Cambrid... \n",
|
||
"18 After completing his studies at Oxford and Durham , Efstathiou worked as an ... \n",
|
||
"19 After obtaining his doctorate from Harvard , Silk returned to England to car... },\n",
|
||
" { 'answer': 'Christopher Wren',\n",
|
||
" 'context': Name Years \\\n",
|
||
"0 John Bainbridge 1620 or 1621 - 1643 \n",
|
||
"1 John Greaves 1643-48 \n",
|
||
"2 Seth Ward 1649-60 \n",
|
||
"3 Christopher Wren 1661-73 \n",
|
||
"4 Edward Bernard 1673-91 \n",
|
||
"5 David Gregory 1691-1708 \n",
|
||
"6 John Caswell 1709-12 \n",
|
||
"7 John Keill 1712-21 \n",
|
||
"8 James Bradley 1721-62 \n",
|
||
"9 Thomas Hornsby 1763-1810 \n",
|
||
"10 Abraham Robertson 1810-26 \n",
|
||
"11 Stephen Rigaud 1827-39 \n",
|
||
"12 George Johnson 1839-42 \n",
|
||
"13 William Donkin 1842-69 \n",
|
||
"14 Charles Pritchard 1870-93 \n",
|
||
"15 Herbert Turner 1893-1930 \n",
|
||
"16 Harry Plaskett 1932-60 \n",
|
||
"17 Donald Blackwell 1960-88 \n",
|
||
"18 George Efstathiou 1988-97 \n",
|
||
"19 Joseph Silk 1999-2012 \n",
|
||
"\n",
|
||
" Education \\\n",
|
||
"0 University of Cambridge ( Emmanuel College ) \n",
|
||
"1 Balliol College \n",
|
||
"2 University of Cambridge ( Sidney Sussex College ) \n",
|
||
"3 Wadham College \n",
|
||
"4 St John 's College \n",
|
||
"5 Marischal College and University of Aberdeen , and Leiden University \n",
|
||
"6 Wadham College \n",
|
||
"7 University of Edinburgh and Balliol College \n",
|
||
"8 Balliol College \n",
|
||
"9 Corpus Christi College \n",
|
||
"10 Christ Church \n",
|
||
"11 Exeter College \n",
|
||
"12 The Queen 's College \n",
|
||
"13 St Edmund Hall and University College \n",
|
||
"14 University of Cambridge ( St John 's College ) \n",
|
||
"15 University of Cambridge ( Trinity College ) \n",
|
||
"16 University of Toronto and Imperial College , London \n",
|
||
"17 University of Cambridge ( Sidney Sussex College ) \n",
|
||
"18 Keble College and the University of Durham \n",
|
||
"19 University of Cambridge ( Clare College ) and Harvard University \n",
|
||
"\n",
|
||
" College as professor \\\n",
|
||
"0 Merton College \n",
|
||
"1 Merton College \n",
|
||
"2 Wadham College and Trinity College \n",
|
||
"3 All Souls College \n",
|
||
"4 St John 's College \n",
|
||
"5 Balliol College \n",
|
||
"6 Hart Hall \n",
|
||
"7 Balliol College \n",
|
||
"8 - \n",
|
||
"9 Corpus Christi College \n",
|
||
"10 Christ Church \n",
|
||
"11 - \n",
|
||
"12 The Queen 's College \n",
|
||
"13 University College \n",
|
||
"14 New College \n",
|
||
"15 New College \n",
|
||
"16 New College \n",
|
||
"17 New College \n",
|
||
"18 New College \n",
|
||
"19 New College \n",
|
||
"\n",
|
||
" Notes \n",
|
||
"0 Bainbridge practised as a physician in Leicestershire and London after leavi... \n",
|
||
"1 Greaves began studying astronomical texts in Greek , Arabic and Persian at a... \n",
|
||
"2 When still an undergraduate , Ward impressed John Bainbridge ( the first ast... \n",
|
||
"3 As an undergraduate , Wren joined the circle of mathematicians and natural s... \n",
|
||
"4 Bernard studied Hebrew , Arabic , Syriac and Coptic with Edward Pococke ( La... \n",
|
||
"5 Gregory studied in his native Scotland and befriended the Edinburgh physicia... \n",
|
||
"6 Carswell matriculated at Wadham College , Oxford , when he was 16 years old ... \n",
|
||
"7 Keill studied in Edinburgh with David Gregory and moved to Balliol with him ... \n",
|
||
"8 Bradley was the nephew of James Pound , a leading astronomer who was a colle... \n",
|
||
"9 Hornsby , who had an observatory at Corpus Christi , gained a high reputatio... \n",
|
||
"10 Robertson started studying at Oxford aged 24 , having previously run ( unsuc... \n",
|
||
"11 Rigaud , whose father was the observer at Kew Observatory , made his first r... \n",
|
||
"12 Johnson was a mathematician and priest with little practical knowledge of as... \n",
|
||
"13 Donkin , a talented linguist , mathematician and musician , published papers... \n",
|
||
"14 After leaving Cambridge , Pritchard was headmaster of a grammar school in St... \n",
|
||
"15 Turner was second wrangler ( achieved the second-highest marks in the Cambri... \n",
|
||
"16 Plaskett , a solar physicist , was the son of the Canadian astronomer John S... \n",
|
||
"17 Blackwell was assistant director of the Solar Physics Observatory at Cambrid... \n",
|
||
"18 After completing his studies at Oxford and Durham , Efstathiou worked as an ... \n",
|
||
"19 After obtaining his doctorate from Harvard , Silk returned to England to car... },\n",
|
||
" { 'answer': 'John Caswell',\n",
|
||
" 'context': Name Years \\\n",
|
||
"0 John Bainbridge 1620 or 1621 - 1643 \n",
|
||
"1 John Greaves 1643-48 \n",
|
||
"2 Seth Ward 1649-60 \n",
|
||
"3 Christopher Wren 1661-73 \n",
|
||
"4 Edward Bernard 1673-91 \n",
|
||
"5 David Gregory 1691-1708 \n",
|
||
"6 John Caswell 1709-12 \n",
|
||
"7 John Keill 1712-21 \n",
|
||
"8 James Bradley 1721-62 \n",
|
||
"9 Thomas Hornsby 1763-1810 \n",
|
||
"10 Abraham Robertson 1810-26 \n",
|
||
"11 Stephen Rigaud 1827-39 \n",
|
||
"12 George Johnson 1839-42 \n",
|
||
"13 William Donkin 1842-69 \n",
|
||
"14 Charles Pritchard 1870-93 \n",
|
||
"15 Herbert Turner 1893-1930 \n",
|
||
"16 Harry Plaskett 1932-60 \n",
|
||
"17 Donald Blackwell 1960-88 \n",
|
||
"18 George Efstathiou 1988-97 \n",
|
||
"19 Joseph Silk 1999-2012 \n",
|
||
"\n",
|
||
" Education \\\n",
|
||
"0 University of Cambridge ( Emmanuel College ) \n",
|
||
"1 Balliol College \n",
|
||
"2 University of Cambridge ( Sidney Sussex College ) \n",
|
||
"3 Wadham College \n",
|
||
"4 St John 's College \n",
|
||
"5 Marischal College and University of Aberdeen , and Leiden University \n",
|
||
"6 Wadham College \n",
|
||
"7 University of Edinburgh and Balliol College \n",
|
||
"8 Balliol College \n",
|
||
"9 Corpus Christi College \n",
|
||
"10 Christ Church \n",
|
||
"11 Exeter College \n",
|
||
"12 The Queen 's College \n",
|
||
"13 St Edmund Hall and University College \n",
|
||
"14 University of Cambridge ( St John 's College ) \n",
|
||
"15 University of Cambridge ( Trinity College ) \n",
|
||
"16 University of Toronto and Imperial College , London \n",
|
||
"17 University of Cambridge ( Sidney Sussex College ) \n",
|
||
"18 Keble College and the University of Durham \n",
|
||
"19 University of Cambridge ( Clare College ) and Harvard University \n",
|
||
"\n",
|
||
" College as professor \\\n",
|
||
"0 Merton College \n",
|
||
"1 Merton College \n",
|
||
"2 Wadham College and Trinity College \n",
|
||
"3 All Souls College \n",
|
||
"4 St John 's College \n",
|
||
"5 Balliol College \n",
|
||
"6 Hart Hall \n",
|
||
"7 Balliol College \n",
|
||
"8 - \n",
|
||
"9 Corpus Christi College \n",
|
||
"10 Christ Church \n",
|
||
"11 - \n",
|
||
"12 The Queen 's College \n",
|
||
"13 University College \n",
|
||
"14 New College \n",
|
||
"15 New College \n",
|
||
"16 New College \n",
|
||
"17 New College \n",
|
||
"18 New College \n",
|
||
"19 New College \n",
|
||
"\n",
|
||
" Notes \n",
|
||
"0 Bainbridge practised as a physician in Leicestershire and London after leavi... \n",
|
||
"1 Greaves began studying astronomical texts in Greek , Arabic and Persian at a... \n",
|
||
"2 When still an undergraduate , Ward impressed John Bainbridge ( the first ast... \n",
|
||
"3 As an undergraduate , Wren joined the circle of mathematicians and natural s... \n",
|
||
"4 Bernard studied Hebrew , Arabic , Syriac and Coptic with Edward Pococke ( La... \n",
|
||
"5 Gregory studied in his native Scotland and befriended the Edinburgh physicia... \n",
|
||
"6 Carswell matriculated at Wadham College , Oxford , when he was 16 years old ... \n",
|
||
"7 Keill studied in Edinburgh with David Gregory and moved to Balliol with him ... \n",
|
||
"8 Bradley was the nephew of James Pound , a leading astronomer who was a colle... \n",
|
||
"9 Hornsby , who had an observatory at Corpus Christi , gained a high reputatio... \n",
|
||
"10 Robertson started studying at Oxford aged 24 , having previously run ( unsuc... \n",
|
||
"11 Rigaud , whose father was the observer at Kew Observatory , made his first r... \n",
|
||
"12 Johnson was a mathematician and priest with little practical knowledge of as... \n",
|
||
"13 Donkin , a talented linguist , mathematician and musician , published papers... \n",
|
||
"14 After leaving Cambridge , Pritchard was headmaster of a grammar school in St... \n",
|
||
"15 Turner was second wrangler ( achieved the second-highest marks in the Cambri... \n",
|
||
"16 Plaskett , a solar physicist , was the son of the Canadian astronomer John S... \n",
|
||
"17 Blackwell was assistant director of the Solar Physics Observatory at Cambrid... \n",
|
||
"18 After completing his studies at Oxford and Durham , Efstathiou worked as an ... \n",
|
||
"19 After obtaining his doctorate from Harvard , Silk returned to England to car... },\n",
|
||
" { 'answer': 'John Caswell',\n",
|
||
" 'context': Name Years \\\n",
|
||
"0 John Bainbridge 1620 or 1621 - 1643 \n",
|
||
"1 John Greaves 1643-48 \n",
|
||
"2 Seth Ward 1649-60 \n",
|
||
"3 Christopher Wren 1661-73 \n",
|
||
"4 Edward Bernard 1673-91 \n",
|
||
"5 David Gregory 1691-1708 \n",
|
||
"6 John Caswell 1709-12 \n",
|
||
"7 John Keill 1712-21 \n",
|
||
"8 James Bradley 1721-62 \n",
|
||
"9 Thomas Hornsby 1763-1810 \n",
|
||
"10 Abraham Robertson 1810-26 \n",
|
||
"11 Stephen Rigaud 1827-39 \n",
|
||
"12 George Johnson 1839-42 \n",
|
||
"13 William Donkin 1842-69 \n",
|
||
"14 Charles Pritchard 1870-93 \n",
|
||
"15 Herbert Turner 1893-1930 \n",
|
||
"16 Harry Plaskett 1932-60 \n",
|
||
"17 Donald Blackwell 1960-88 \n",
|
||
"18 George Efstathiou 1988-97 \n",
|
||
"19 Joseph Silk 1999-2012 \n",
|
||
"\n",
|
||
" Education \\\n",
|
||
"0 University of Cambridge ( Emmanuel College ) \n",
|
||
"1 Balliol College \n",
|
||
"2 University of Cambridge ( Sidney Sussex College ) \n",
|
||
"3 Wadham College \n",
|
||
"4 St John 's College \n",
|
||
"5 Marischal College and University of Aberdeen , and Leiden University \n",
|
||
"6 Wadham College \n",
|
||
"7 University of Edinburgh and Balliol College \n",
|
||
"8 Balliol College \n",
|
||
"9 Corpus Christi College \n",
|
||
"10 Christ Church \n",
|
||
"11 Exeter College \n",
|
||
"12 The Queen 's College \n",
|
||
"13 St Edmund Hall and University College \n",
|
||
"14 University of Cambridge ( St John 's College ) \n",
|
||
"15 University of Cambridge ( Trinity College ) \n",
|
||
"16 University of Toronto and Imperial College , London \n",
|
||
"17 University of Cambridge ( Sidney Sussex College ) \n",
|
||
"18 Keble College and the University of Durham \n",
|
||
"19 University of Cambridge ( Clare College ) and Harvard University \n",
|
||
"\n",
|
||
" College as professor \\\n",
|
||
"0 Merton College \n",
|
||
"1 Merton College \n",
|
||
"2 Wadham College and Trinity College \n",
|
||
"3 All Souls College \n",
|
||
"4 St John 's College \n",
|
||
"5 Balliol College \n",
|
||
"6 Hart Hall \n",
|
||
"7 Balliol College \n",
|
||
"8 - \n",
|
||
"9 Corpus Christi College \n",
|
||
"10 Christ Church \n",
|
||
"11 - \n",
|
||
"12 The Queen 's College \n",
|
||
"13 University College \n",
|
||
"14 New College \n",
|
||
"15 New College \n",
|
||
"16 New College \n",
|
||
"17 New College \n",
|
||
"18 New College \n",
|
||
"19 New College \n",
|
||
"\n",
|
||
" Notes \n",
|
||
"0 Bainbridge practised as a physician in Leicestershire and London after leavi... \n",
|
||
"1 Greaves began studying astronomical texts in Greek , Arabic and Persian at a... \n",
|
||
"2 When still an undergraduate , Ward impressed John Bainbridge ( the first ast... \n",
|
||
"3 As an undergraduate , Wren joined the circle of mathematicians and natural s... \n",
|
||
"4 Bernard studied Hebrew , Arabic , Syriac and Coptic with Edward Pococke ( La... \n",
|
||
"5 Gregory studied in his native Scotland and befriended the Edinburgh physicia... \n",
|
||
"6 Carswell matriculated at Wadham College , Oxford , when he was 16 years old ... \n",
|
||
"7 Keill studied in Edinburgh with David Gregory and moved to Balliol with him ... \n",
|
||
"8 Bradley was the nephew of James Pound , a leading astronomer who was a colle... \n",
|
||
"9 Hornsby , who had an observatory at Corpus Christi , gained a high reputatio... \n",
|
||
"10 Robertson started studying at Oxford aged 24 , having previously run ( unsuc... \n",
|
||
"11 Rigaud , whose father was the observer at Kew Observatory , made his first r... \n",
|
||
"12 Johnson was a mathematician and priest with little practical knowledge of as... \n",
|
||
"13 Donkin , a talented linguist , mathematician and musician , published papers... \n",
|
||
"14 After leaving Cambridge , Pritchard was headmaster of a grammar school in St... \n",
|
||
"15 Turner was second wrangler ( achieved the second-highest marks in the Cambri... \n",
|
||
"16 Plaskett , a solar physicist , was the son of the Canadian astronomer John S... \n",
|
||
"17 Blackwell was assistant director of the Solar Physics Observatory at Cambrid... \n",
|
||
"18 After completing his studies at Oxford and Durham , Efstathiou worked as an ... \n",
|
||
"19 After obtaining his doctorate from Harvard , Silk returned to England to car... },\n",
|
||
" { 'answer': 'Thomas Hornsby',\n",
|
||
" 'context': Name Years \\\n",
|
||
"0 John Bainbridge 1620 or 1621 - 1643 \n",
|
||
"1 John Greaves 1643-48 \n",
|
||
"2 Seth Ward 1649-60 \n",
|
||
"3 Christopher Wren 1661-73 \n",
|
||
"4 Edward Bernard 1673-91 \n",
|
||
"5 David Gregory 1691-1708 \n",
|
||
"6 John Caswell 1709-12 \n",
|
||
"7 John Keill 1712-21 \n",
|
||
"8 James Bradley 1721-62 \n",
|
||
"9 Thomas Hornsby 1763-1810 \n",
|
||
"10 Abraham Robertson 1810-26 \n",
|
||
"11 Stephen Rigaud 1827-39 \n",
|
||
"12 George Johnson 1839-42 \n",
|
||
"13 William Donkin 1842-69 \n",
|
||
"14 Charles Pritchard 1870-93 \n",
|
||
"15 Herbert Turner 1893-1930 \n",
|
||
"16 Harry Plaskett 1932-60 \n",
|
||
"17 Donald Blackwell 1960-88 \n",
|
||
"18 George Efstathiou 1988-97 \n",
|
||
"19 Joseph Silk 1999-2012 \n",
|
||
"\n",
|
||
" Education \\\n",
|
||
"0 University of Cambridge ( Emmanuel College ) \n",
|
||
"1 Balliol College \n",
|
||
"2 University of Cambridge ( Sidney Sussex College ) \n",
|
||
"3 Wadham College \n",
|
||
"4 St John 's College \n",
|
||
"5 Marischal College and University of Aberdeen , and Leiden University \n",
|
||
"6 Wadham College \n",
|
||
"7 University of Edinburgh and Balliol College \n",
|
||
"8 Balliol College \n",
|
||
"9 Corpus Christi College \n",
|
||
"10 Christ Church \n",
|
||
"11 Exeter College \n",
|
||
"12 The Queen 's College \n",
|
||
"13 St Edmund Hall and University College \n",
|
||
"14 University of Cambridge ( St John 's College ) \n",
|
||
"15 University of Cambridge ( Trinity College ) \n",
|
||
"16 University of Toronto and Imperial College , London \n",
|
||
"17 University of Cambridge ( Sidney Sussex College ) \n",
|
||
"18 Keble College and the University of Durham \n",
|
||
"19 University of Cambridge ( Clare College ) and Harvard University \n",
|
||
"\n",
|
||
" College as professor \\\n",
|
||
"0 Merton College \n",
|
||
"1 Merton College \n",
|
||
"2 Wadham College and Trinity College \n",
|
||
"3 All Souls College \n",
|
||
"4 St John 's College \n",
|
||
"5 Balliol College \n",
|
||
"6 Hart Hall \n",
|
||
"7 Balliol College \n",
|
||
"8 - \n",
|
||
"9 Corpus Christi College \n",
|
||
"10 Christ Church \n",
|
||
"11 - \n",
|
||
"12 The Queen 's College \n",
|
||
"13 University College \n",
|
||
"14 New College \n",
|
||
"15 New College \n",
|
||
"16 New College \n",
|
||
"17 New College \n",
|
||
"18 New College \n",
|
||
"19 New College \n",
|
||
"\n",
|
||
" Notes \n",
|
||
"0 Bainbridge practised as a physician in Leicestershire and London after leavi... \n",
|
||
"1 Greaves began studying astronomical texts in Greek , Arabic and Persian at a... \n",
|
||
"2 When still an undergraduate , Ward impressed John Bainbridge ( the first ast... \n",
|
||
"3 As an undergraduate , Wren joined the circle of mathematicians and natural s... \n",
|
||
"4 Bernard studied Hebrew , Arabic , Syriac and Coptic with Edward Pococke ( La... \n",
|
||
"5 Gregory studied in his native Scotland and befriended the Edinburgh physicia... \n",
|
||
"6 Carswell matriculated at Wadham College , Oxford , when he was 16 years old ... \n",
|
||
"7 Keill studied in Edinburgh with David Gregory and moved to Balliol with him ... \n",
|
||
"8 Bradley was the nephew of James Pound , a leading astronomer who was a colle... \n",
|
||
"9 Hornsby , who had an observatory at Corpus Christi , gained a high reputatio... \n",
|
||
"10 Robertson started studying at Oxford aged 24 , having previously run ( unsuc... \n",
|
||
"11 Rigaud , whose father was the observer at Kew Observatory , made his first r... \n",
|
||
"12 Johnson was a mathematician and priest with little practical knowledge of as... \n",
|
||
"13 Donkin , a talented linguist , mathematician and musician , published papers... \n",
|
||
"14 After leaving Cambridge , Pritchard was headmaster of a grammar school in St... \n",
|
||
"15 Turner was second wrangler ( achieved the second-highest marks in the Cambri... \n",
|
||
"16 Plaskett , a solar physicist , was the son of the Canadian astronomer John S... \n",
|
||
"17 Blackwell was assistant director of the Solar Physics Observatory at Cambrid... \n",
|
||
"18 After completing his studies at Oxford and Durham , Efstathiou worked as an ... \n",
|
||
"19 After obtaining his doctorate from Harvard , Silk returned to England to car... },\n",
|
||
" { 'answer': 'Thomas Hornsby',\n",
|
||
" 'context': Name Years \\\n",
|
||
"0 John Bainbridge 1620 or 1621 - 1643 \n",
|
||
"1 John Greaves 1643-48 \n",
|
||
"2 Seth Ward 1649-60 \n",
|
||
"3 Christopher Wren 1661-73 \n",
|
||
"4 Edward Bernard 1673-91 \n",
|
||
"5 David Gregory 1691-1708 \n",
|
||
"6 John Caswell 1709-12 \n",
|
||
"7 John Keill 1712-21 \n",
|
||
"8 James Bradley 1721-62 \n",
|
||
"9 Thomas Hornsby 1763-1810 \n",
|
||
"10 Abraham Robertson 1810-26 \n",
|
||
"11 Stephen Rigaud 1827-39 \n",
|
||
"12 George Johnson 1839-42 \n",
|
||
"13 William Donkin 1842-69 \n",
|
||
"14 Charles Pritchard 1870-93 \n",
|
||
"15 Herbert Turner 1893-1930 \n",
|
||
"16 Harry Plaskett 1932-60 \n",
|
||
"17 Donald Blackwell 1960-88 \n",
|
||
"18 George Efstathiou 1988-97 \n",
|
||
"19 Joseph Silk 1999-2012 \n",
|
||
"\n",
|
||
" Education \\\n",
|
||
"0 University of Cambridge ( Emmanuel College ) \n",
|
||
"1 Balliol College \n",
|
||
"2 University of Cambridge ( Sidney Sussex College ) \n",
|
||
"3 Wadham College \n",
|
||
"4 St John 's College \n",
|
||
"5 Marischal College and University of Aberdeen , and Leiden University \n",
|
||
"6 Wadham College \n",
|
||
"7 University of Edinburgh and Balliol College \n",
|
||
"8 Balliol College \n",
|
||
"9 Corpus Christi College \n",
|
||
"10 Christ Church \n",
|
||
"11 Exeter College \n",
|
||
"12 The Queen 's College \n",
|
||
"13 St Edmund Hall and University College \n",
|
||
"14 University of Cambridge ( St John 's College ) \n",
|
||
"15 University of Cambridge ( Trinity College ) \n",
|
||
"16 University of Toronto and Imperial College , London \n",
|
||
"17 University of Cambridge ( Sidney Sussex College ) \n",
|
||
"18 Keble College and the University of Durham \n",
|
||
"19 University of Cambridge ( Clare College ) and Harvard University \n",
|
||
"\n",
|
||
" College as professor \\\n",
|
||
"0 Merton College \n",
|
||
"1 Merton College \n",
|
||
"2 Wadham College and Trinity College \n",
|
||
"3 All Souls College \n",
|
||
"4 St John 's College \n",
|
||
"5 Balliol College \n",
|
||
"6 Hart Hall \n",
|
||
"7 Balliol College \n",
|
||
"8 - \n",
|
||
"9 Corpus Christi College \n",
|
||
"10 Christ Church \n",
|
||
"11 - \n",
|
||
"12 The Queen 's College \n",
|
||
"13 University College \n",
|
||
"14 New College \n",
|
||
"15 New College \n",
|
||
"16 New College \n",
|
||
"17 New College \n",
|
||
"18 New College \n",
|
||
"19 New College \n",
|
||
"\n",
|
||
" Notes \n",
|
||
"0 Bainbridge practised as a physician in Leicestershire and London after leavi... \n",
|
||
"1 Greaves began studying astronomical texts in Greek , Arabic and Persian at a... \n",
|
||
"2 When still an undergraduate , Ward impressed John Bainbridge ( the first ast... \n",
|
||
"3 As an undergraduate , Wren joined the circle of mathematicians and natural s... \n",
|
||
"4 Bernard studied Hebrew , Arabic , Syriac and Coptic with Edward Pococke ( La... \n",
|
||
"5 Gregory studied in his native Scotland and befriended the Edinburgh physicia... \n",
|
||
"6 Carswell matriculated at Wadham College , Oxford , when he was 16 years old ... \n",
|
||
"7 Keill studied in Edinburgh with David Gregory and moved to Balliol with him ... \n",
|
||
"8 Bradley was the nephew of James Pound , a leading astronomer who was a colle... \n",
|
||
"9 Hornsby , who had an observatory at Corpus Christi , gained a high reputatio... \n",
|
||
"10 Robertson started studying at Oxford aged 24 , having previously run ( unsuc... \n",
|
||
"11 Rigaud , whose father was the observer at Kew Observatory , made his first r... \n",
|
||
"12 Johnson was a mathematician and priest with little practical knowledge of as... \n",
|
||
"13 Donkin , a talented linguist , mathematician and musician , published papers... \n",
|
||
"14 After leaving Cambridge , Pritchard was headmaster of a grammar school in St... \n",
|
||
"15 Turner was second wrangler ( achieved the second-highest marks in the Cambri... \n",
|
||
"16 Plaskett , a solar physicist , was the son of the Canadian astronomer John S... \n",
|
||
"17 Blackwell was assistant director of the Solar Physics Observatory at Cambrid... \n",
|
||
"18 After completing his studies at Oxford and Durham , Efstathiou worked as an ... \n",
|
||
"19 After obtaining his doctorate from Harvard , Silk returned to England to car... },\n",
|
||
" { 'answer': 'John Jordan',\n",
|
||
" 'context': Entrant Constructor Chassis Engine Driver\n",
|
||
"0 Team Ensign Ensign N180B Cosworth DFV V8 Jim Crawford\n",
|
||
"1 Team Ensign Ensign N180B Cosworth DFV V8 Joe Castellano\n",
|
||
"2 Colin Bennett Racing McLaren M29 Cosworth DFV V8 Arnold Glass\n",
|
||
"3 Colin Bennett Racing March 811 Cosworth DFV V8 Val Musetti\n",
|
||
"4 Team Sanada Fittipaldi F8 Cosworth DFV V8 Tony Trimmer\n",
|
||
"5 Warren Booth Shadow DN9 Cosworth DFV V8 Warren Booth\n",
|
||
"6 John Jordan BRM P207 BRM 202 V12 David Williams\n",
|
||
"7 Nick Mason Tyrrell 008 Cosworth DFV V8 John Brindley\n",
|
||
"8 EMKA Productions Williams FW07 Cosworth DFV V8 Steve O'Rourke\n",
|
||
"9 Team Peru Williams FW07 Cosworth DFV V8 Jorge Koechlin},\n",
|
||
" { 'answer': 'Alexander Graham Bell Alexander Graham Bell',\n",
|
||
" 'context': 'is grandchildren. \"U.S. patent images in TIFF format\" '\n",
|
||
" 'Alexander Graham Bell Alexander Graham Bell (March 3, 1847 '\n",
|
||
" '– August 2, 1922) was a Scottish-born'},\n",
|
||
" { 'answer': 'Ernst Heinrich Weber was clear from his memoirs where he '\n",
|
||
" 'proclaimed that Weber should be regarded as the father of '\n",
|
||
" 'experimental psychology. . “I would rather call Weber the '\n",
|
||
" 'father of experimental psychology…It was Weber’s great '\n",
|
||
" 'contribution to think of measuring psychic quantities and '\n",
|
||
" 'of showing the exact relationships between them, to be the '\n",
|
||
" 'first to understand this and carry it out.',\n",
|
||
" 'context': ' Ernst Heinrich Weber was clear from his memoirs where he '\n",
|
||
" 'proclaimed that Weber should be regarded as the father of '\n",
|
||
" 'experimental psychology. . “I would rather call Weber the '\n",
|
||
" 'father of experimental psychology…It was Weber’s great '\n",
|
||
" 'contribution to think of measuring psychic quantities and '\n",
|
||
" 'of showing the exact relationships between them, to be the '\n",
|
||
" 'first to understand this and carry it out.'}]\n"
|
||
]
|
||
}
|
||
],
|
||
"source": [
|
||
"# We can see both text passages and tables as contexts of the predicted answers.\n",
|
||
"print_answers(predictions, details=\"minimum\")"
|
||
]
|
||
},
|
||
{
|
||
"cell_type": "code",
|
||
"execution_count": null,
|
||
"metadata": {
|
||
"id": "QYOHDSmLpzEg"
|
||
},
|
||
"outputs": [],
|
||
"source": [
|
||
"# Example query whose answer resides in a table\n",
|
||
"predictions = text_table_qa_pipeline.run(query=\"Which country does the film Macaroni come from?\")"
|
||
]
|
||
},
|
||
{
|
||
"cell_type": "code",
|
||
"execution_count": 24,
|
||
"metadata": {
|
||
"colab": {
|
||
"base_uri": "https://localhost:8080/"
|
||
},
|
||
"id": "4kw53uWep3zj",
|
||
"outputId": "b332cc17-3cb8-4e20-d79d-bb4cf656f277"
|
||
},
|
||
"outputs": [
|
||
{
|
||
"name": "stdout",
|
||
"output_type": "stream",
|
||
"text": [
|
||
"\n",
|
||
"Query: Which country does the film Macaroni come from?\n",
|
||
"Answers:\n",
|
||
"[ { 'answer': 'Italian',\n",
|
||
" 'context': Submitting country Film title used in nomination Language ( s ) \\\n",
|
||
"0 Argentina The Official Story Spanish \n",
|
||
"1 Austria Malambo German \n",
|
||
"2 Belgium Dust French \n",
|
||
"3 Canada Jacques and November French \n",
|
||
"4 Czechoslovakia Scalpel , Please Czech \n",
|
||
"5 Denmark Twist and Shout Danish \n",
|
||
"6 France Three Men and a Cradle French \n",
|
||
"7 West Germany Angry Harvest German \n",
|
||
"8 Hungary Colonel Redl German \n",
|
||
"9 Iceland Deep Winter Icelandic \n",
|
||
"10 India Saagar Hindi \n",
|
||
"11 Israel When Night Falls Hebrew \n",
|
||
"12 Italy Macaroni Italian \n",
|
||
"13 Japan Gray Sunset Japanese \n",
|
||
"14 South Korea Eoudong Korean \n",
|
||
"15 Mexico Frida Still Life Spanish \n",
|
||
"16 Netherlands The Dream Dutch , West Frisian \n",
|
||
"17 Norway Wives - Ten Years After Norwegian \n",
|
||
"18 Peru The City and the Dogs Spanish \n",
|
||
"19 Philippines This Is My Country Tagalog \n",
|
||
"\n",
|
||
" Original title Director ( s ) \\\n",
|
||
"0 La Historia oficial Luis Puenzo \n",
|
||
"1 Malambo Milan Dor \n",
|
||
"2 Dust Marion Hänsel \n",
|
||
"3 Jacques et novembre Jean Beaudry and François Bouvier \n",
|
||
"4 Skalpel , prosím Jirí Svoboda \n",
|
||
"5 Tro , håb og kærlighed Bille August \n",
|
||
"6 Trois hommes et un couffin Coline Serreau \n",
|
||
"7 Bittere Ernte Agnieszka Holland \n",
|
||
"8 Oberst Redl István Szabó \n",
|
||
"9 Skammdegi Þráinn Bertelsson \n",
|
||
"10 सागर Ramesh Sippy \n",
|
||
"11 עד סוף הלילה Eitan Green \n",
|
||
"12 Maccheroni Ettore Scola \n",
|
||
"13 花いちもんめ Shunya Ito \n",
|
||
"14 어우동 Lee Jang-ho \n",
|
||
"15 Frida , naturaleza viva Paul Leduc \n",
|
||
"16 De Dream Pieter Verhoeff \n",
|
||
"17 Hustruer - ti år etter Anja Breien \n",
|
||
"18 La ciudad y los perros Francisco José Lombardi \n",
|
||
"19 Bayan ko : Kapit sa patalim Lino Brocka \n",
|
||
"\n",
|
||
" Result \n",
|
||
"0 Won Academy Award \n",
|
||
"1 Not Nominated \n",
|
||
"2 Not Nominated \n",
|
||
"3 Not Nominated \n",
|
||
"4 Not Nominated \n",
|
||
"5 Not Nominated \n",
|
||
"6 Nominated \n",
|
||
"7 Nominated \n",
|
||
"8 Nominated \n",
|
||
"9 Not Nominated \n",
|
||
"10 Not Nominated \n",
|
||
"11 Not Nominated \n",
|
||
"12 Not Nominated \n",
|
||
"13 Not Nominated \n",
|
||
"14 Not Nominated \n",
|
||
"15 Not Nominated \n",
|
||
"16 Not Nominated \n",
|
||
"17 Not Nominated \n",
|
||
"18 Not Nominated \n",
|
||
"19 Not Nominated },\n",
|
||
" { 'answer': 'Italian',\n",
|
||
" 'context': Submitting country Film title used in nomination Language ( s ) \\\n",
|
||
"0 Argentina The Official Story Spanish \n",
|
||
"1 Austria Malambo German \n",
|
||
"2 Belgium Dust French \n",
|
||
"3 Canada Jacques and November French \n",
|
||
"4 Czechoslovakia Scalpel , Please Czech \n",
|
||
"5 Denmark Twist and Shout Danish \n",
|
||
"6 France Three Men and a Cradle French \n",
|
||
"7 West Germany Angry Harvest German \n",
|
||
"8 Hungary Colonel Redl German \n",
|
||
"9 Iceland Deep Winter Icelandic \n",
|
||
"10 India Saagar Hindi \n",
|
||
"11 Israel When Night Falls Hebrew \n",
|
||
"12 Italy Macaroni Italian \n",
|
||
"13 Japan Gray Sunset Japanese \n",
|
||
"14 South Korea Eoudong Korean \n",
|
||
"15 Mexico Frida Still Life Spanish \n",
|
||
"16 Netherlands The Dream Dutch , West Frisian \n",
|
||
"17 Norway Wives - Ten Years After Norwegian \n",
|
||
"18 Peru The City and the Dogs Spanish \n",
|
||
"19 Philippines This Is My Country Tagalog \n",
|
||
"\n",
|
||
" Original title Director ( s ) \\\n",
|
||
"0 La Historia oficial Luis Puenzo \n",
|
||
"1 Malambo Milan Dor \n",
|
||
"2 Dust Marion Hänsel \n",
|
||
"3 Jacques et novembre Jean Beaudry and François Bouvier \n",
|
||
"4 Skalpel , prosím Jirí Svoboda \n",
|
||
"5 Tro , håb og kærlighed Bille August \n",
|
||
"6 Trois hommes et un couffin Coline Serreau \n",
|
||
"7 Bittere Ernte Agnieszka Holland \n",
|
||
"8 Oberst Redl István Szabó \n",
|
||
"9 Skammdegi Þráinn Bertelsson \n",
|
||
"10 सागर Ramesh Sippy \n",
|
||
"11 עד סוף הלילה Eitan Green \n",
|
||
"12 Maccheroni Ettore Scola \n",
|
||
"13 花いちもんめ Shunya Ito \n",
|
||
"14 어우동 Lee Jang-ho \n",
|
||
"15 Frida , naturaleza viva Paul Leduc \n",
|
||
"16 De Dream Pieter Verhoeff \n",
|
||
"17 Hustruer - ti år etter Anja Breien \n",
|
||
"18 La ciudad y los perros Francisco José Lombardi \n",
|
||
"19 Bayan ko : Kapit sa patalim Lino Brocka \n",
|
||
"\n",
|
||
" Result \n",
|
||
"0 Won Academy Award \n",
|
||
"1 Not Nominated \n",
|
||
"2 Not Nominated \n",
|
||
"3 Not Nominated \n",
|
||
"4 Not Nominated \n",
|
||
"5 Not Nominated \n",
|
||
"6 Nominated \n",
|
||
"7 Nominated \n",
|
||
"8 Nominated \n",
|
||
"9 Not Nominated \n",
|
||
"10 Not Nominated \n",
|
||
"11 Not Nominated \n",
|
||
"12 Not Nominated \n",
|
||
"13 Not Nominated \n",
|
||
"14 Not Nominated \n",
|
||
"15 Not Nominated \n",
|
||
"16 Not Nominated \n",
|
||
"17 Not Nominated \n",
|
||
"18 Not Nominated \n",
|
||
"19 Not Nominated },\n",
|
||
" { 'answer': '2014',\n",
|
||
" 'context': Year Name Transliteration \\\n",
|
||
"0 2000 The Child And The Soldier Koodak va Sarbaz \n",
|
||
"1 2001 Under The Moonlight Zir-e Noor-e Maah \n",
|
||
"2 2002 Here Is A Shining Light Inja Cheraghi Roshan Ast \n",
|
||
"3 2005 So Close , So Far Kheili Dour , Kheili Nazdik \n",
|
||
"4 2008 As Simple as That Be Hamin Sadegi \n",
|
||
"5 2011 A Cube of Sugar Yek Habe Ghand \n",
|
||
"6 2014 Today Emrooz \n",
|
||
"7 2016 Daughter Dokhtar \n",
|
||
"8 2019 Castle of Dreams Ghasr-e Shirin \n",
|
||
"\n",
|
||
" Award \n",
|
||
"0 Nominated Grand Prix des Amériques Montréal World Film Festival 2000 Silver ... \n",
|
||
"1 International Jury Award São Paulo International Film Festival 2001 Best Dir... \n",
|
||
"2 Best Screenplay Asia-Pacific Film Festival 2002 Crystal Simorgh Best Directo... \n",
|
||
"3 Crystal Simorgh National Competition - Best Film Fajr International Film Fes... \n",
|
||
"4 Golden St. George 30th Moscow International Film Festival 2008 Russian Guild... \n",
|
||
"5 Special Jury Prize Kazan International Festival of Muslim Cinema 2012 Best F... \n",
|
||
"6 Best Film Award Rabat International Film Festival 2014 Ecumenical Jury Prize... \n",
|
||
"7 Crystal Simorgh National Competition - Best Original Score Fajr Internationa... \n",
|
||
"8 Golden Goblet Award for Best Feature Film Shanghai International Film Festiv... },\n",
|
||
" { 'answer': '2008',\n",
|
||
" 'context': Year Name Transliteration \\\n",
|
||
"0 2000 The Child And The Soldier Koodak va Sarbaz \n",
|
||
"1 2001 Under The Moonlight Zir-e Noor-e Maah \n",
|
||
"2 2002 Here Is A Shining Light Inja Cheraghi Roshan Ast \n",
|
||
"3 2005 So Close , So Far Kheili Dour , Kheili Nazdik \n",
|
||
"4 2008 As Simple as That Be Hamin Sadegi \n",
|
||
"5 2011 A Cube of Sugar Yek Habe Ghand \n",
|
||
"6 2014 Today Emrooz \n",
|
||
"7 2016 Daughter Dokhtar \n",
|
||
"8 2019 Castle of Dreams Ghasr-e Shirin \n",
|
||
"\n",
|
||
" Award \n",
|
||
"0 Nominated Grand Prix des Amériques Montréal World Film Festival 2000 Silver ... \n",
|
||
"1 International Jury Award São Paulo International Film Festival 2001 Best Dir... \n",
|
||
"2 Best Screenplay Asia-Pacific Film Festival 2002 Crystal Simorgh Best Directo... \n",
|
||
"3 Crystal Simorgh National Competition - Best Film Fajr International Film Fes... \n",
|
||
"4 Golden St. George 30th Moscow International Film Festival 2008 Russian Guild... \n",
|
||
"5 Special Jury Prize Kazan International Festival of Muslim Cinema 2012 Best F... \n",
|
||
"6 Best Film Award Rabat International Film Festival 2014 Ecumenical Jury Prize... \n",
|
||
"7 Crystal Simorgh National Competition - Best Original Score Fajr Internationa... \n",
|
||
"8 Golden Goblet Award for Best Feature Film Shanghai International Film Festiv... },\n",
|
||
" { 'answer': 'Daughter',\n",
|
||
" 'context': Year Name Transliteration \\\n",
|
||
"0 2000 The Child And The Soldier Koodak va Sarbaz \n",
|
||
"1 2001 Under The Moonlight Zir-e Noor-e Maah \n",
|
||
"2 2002 Here Is A Shining Light Inja Cheraghi Roshan Ast \n",
|
||
"3 2005 So Close , So Far Kheili Dour , Kheili Nazdik \n",
|
||
"4 2008 As Simple as That Be Hamin Sadegi \n",
|
||
"5 2011 A Cube of Sugar Yek Habe Ghand \n",
|
||
"6 2014 Today Emrooz \n",
|
||
"7 2016 Daughter Dokhtar \n",
|
||
"8 2019 Castle of Dreams Ghasr-e Shirin \n",
|
||
"\n",
|
||
" Award \n",
|
||
"0 Nominated Grand Prix des Amériques Montréal World Film Festival 2000 Silver ... \n",
|
||
"1 International Jury Award São Paulo International Film Festival 2001 Best Dir... \n",
|
||
"2 Best Screenplay Asia-Pacific Film Festival 2002 Crystal Simorgh Best Directo... \n",
|
||
"3 Crystal Simorgh National Competition - Best Film Fajr International Film Fes... \n",
|
||
"4 Golden St. George 30th Moscow International Film Festival 2008 Russian Guild... \n",
|
||
"5 Special Jury Prize Kazan International Festival of Muslim Cinema 2012 Best F... \n",
|
||
"6 Best Film Award Rabat International Film Festival 2014 Ecumenical Jury Prize... \n",
|
||
"7 Crystal Simorgh National Competition - Best Original Score Fajr Internationa... \n",
|
||
"8 Golden Goblet Award for Best Feature Film Shanghai International Film Festiv... },\n",
|
||
" { 'answer': 'Icelandic',\n",
|
||
" 'context': Submitting country Film title used in nomination Language ( s ) \\\n",
|
||
"0 Argentina The Official Story Spanish \n",
|
||
"1 Austria Malambo German \n",
|
||
"2 Belgium Dust French \n",
|
||
"3 Canada Jacques and November French \n",
|
||
"4 Czechoslovakia Scalpel , Please Czech \n",
|
||
"5 Denmark Twist and Shout Danish \n",
|
||
"6 France Three Men and a Cradle French \n",
|
||
"7 West Germany Angry Harvest German \n",
|
||
"8 Hungary Colonel Redl German \n",
|
||
"9 Iceland Deep Winter Icelandic \n",
|
||
"10 India Saagar Hindi \n",
|
||
"11 Israel When Night Falls Hebrew \n",
|
||
"12 Italy Macaroni Italian \n",
|
||
"13 Japan Gray Sunset Japanese \n",
|
||
"14 South Korea Eoudong Korean \n",
|
||
"15 Mexico Frida Still Life Spanish \n",
|
||
"16 Netherlands The Dream Dutch , West Frisian \n",
|
||
"17 Norway Wives - Ten Years After Norwegian \n",
|
||
"18 Peru The City and the Dogs Spanish \n",
|
||
"19 Philippines This Is My Country Tagalog \n",
|
||
"\n",
|
||
" Original title Director ( s ) \\\n",
|
||
"0 La Historia oficial Luis Puenzo \n",
|
||
"1 Malambo Milan Dor \n",
|
||
"2 Dust Marion Hänsel \n",
|
||
"3 Jacques et novembre Jean Beaudry and François Bouvier \n",
|
||
"4 Skalpel , prosím Jirí Svoboda \n",
|
||
"5 Tro , håb og kærlighed Bille August \n",
|
||
"6 Trois hommes et un couffin Coline Serreau \n",
|
||
"7 Bittere Ernte Agnieszka Holland \n",
|
||
"8 Oberst Redl István Szabó \n",
|
||
"9 Skammdegi Þráinn Bertelsson \n",
|
||
"10 सागर Ramesh Sippy \n",
|
||
"11 עד סוף הלילה Eitan Green \n",
|
||
"12 Maccheroni Ettore Scola \n",
|
||
"13 花いちもんめ Shunya Ito \n",
|
||
"14 어우동 Lee Jang-ho \n",
|
||
"15 Frida , naturaleza viva Paul Leduc \n",
|
||
"16 De Dream Pieter Verhoeff \n",
|
||
"17 Hustruer - ti år etter Anja Breien \n",
|
||
"18 La ciudad y los perros Francisco José Lombardi \n",
|
||
"19 Bayan ko : Kapit sa patalim Lino Brocka \n",
|
||
"\n",
|
||
" Result \n",
|
||
"0 Won Academy Award \n",
|
||
"1 Not Nominated \n",
|
||
"2 Not Nominated \n",
|
||
"3 Not Nominated \n",
|
||
"4 Not Nominated \n",
|
||
"5 Not Nominated \n",
|
||
"6 Nominated \n",
|
||
"7 Nominated \n",
|
||
"8 Nominated \n",
|
||
"9 Not Nominated \n",
|
||
"10 Not Nominated \n",
|
||
"11 Not Nominated \n",
|
||
"12 Not Nominated \n",
|
||
"13 Not Nominated \n",
|
||
"14 Not Nominated \n",
|
||
"15 Not Nominated \n",
|
||
"16 Not Nominated \n",
|
||
"17 Not Nominated \n",
|
||
"18 Not Nominated \n",
|
||
"19 Not Nominated },\n",
|
||
" { 'answer': 'Icelandic',\n",
|
||
" 'context': Submitting country Film title used in nomination Language ( s ) \\\n",
|
||
"0 Argentina The Official Story Spanish \n",
|
||
"1 Austria Malambo German \n",
|
||
"2 Belgium Dust French \n",
|
||
"3 Canada Jacques and November French \n",
|
||
"4 Czechoslovakia Scalpel , Please Czech \n",
|
||
"5 Denmark Twist and Shout Danish \n",
|
||
"6 France Three Men and a Cradle French \n",
|
||
"7 West Germany Angry Harvest German \n",
|
||
"8 Hungary Colonel Redl German \n",
|
||
"9 Iceland Deep Winter Icelandic \n",
|
||
"10 India Saagar Hindi \n",
|
||
"11 Israel When Night Falls Hebrew \n",
|
||
"12 Italy Macaroni Italian \n",
|
||
"13 Japan Gray Sunset Japanese \n",
|
||
"14 South Korea Eoudong Korean \n",
|
||
"15 Mexico Frida Still Life Spanish \n",
|
||
"16 Netherlands The Dream Dutch , West Frisian \n",
|
||
"17 Norway Wives - Ten Years After Norwegian \n",
|
||
"18 Peru The City and the Dogs Spanish \n",
|
||
"19 Philippines This Is My Country Tagalog \n",
|
||
"\n",
|
||
" Original title Director ( s ) \\\n",
|
||
"0 La Historia oficial Luis Puenzo \n",
|
||
"1 Malambo Milan Dor \n",
|
||
"2 Dust Marion Hänsel \n",
|
||
"3 Jacques et novembre Jean Beaudry and François Bouvier \n",
|
||
"4 Skalpel , prosím Jirí Svoboda \n",
|
||
"5 Tro , håb og kærlighed Bille August \n",
|
||
"6 Trois hommes et un couffin Coline Serreau \n",
|
||
"7 Bittere Ernte Agnieszka Holland \n",
|
||
"8 Oberst Redl István Szabó \n",
|
||
"9 Skammdegi Þráinn Bertelsson \n",
|
||
"10 सागर Ramesh Sippy \n",
|
||
"11 עד סוף הלילה Eitan Green \n",
|
||
"12 Maccheroni Ettore Scola \n",
|
||
"13 花いちもんめ Shunya Ito \n",
|
||
"14 어우동 Lee Jang-ho \n",
|
||
"15 Frida , naturaleza viva Paul Leduc \n",
|
||
"16 De Dream Pieter Verhoeff \n",
|
||
"17 Hustruer - ti år etter Anja Breien \n",
|
||
"18 La ciudad y los perros Francisco José Lombardi \n",
|
||
"19 Bayan ko : Kapit sa patalim Lino Brocka \n",
|
||
"\n",
|
||
" Result \n",
|
||
"0 Won Academy Award \n",
|
||
"1 Not Nominated \n",
|
||
"2 Not Nominated \n",
|
||
"3 Not Nominated \n",
|
||
"4 Not Nominated \n",
|
||
"5 Not Nominated \n",
|
||
"6 Nominated \n",
|
||
"7 Nominated \n",
|
||
"8 Nominated \n",
|
||
"9 Not Nominated \n",
|
||
"10 Not Nominated \n",
|
||
"11 Not Nominated \n",
|
||
"12 Not Nominated \n",
|
||
"13 Not Nominated \n",
|
||
"14 Not Nominated \n",
|
||
"15 Not Nominated \n",
|
||
"16 Not Nominated \n",
|
||
"17 Not Nominated \n",
|
||
"18 Not Nominated \n",
|
||
"19 Not Nominated },\n",
|
||
" { 'answer': 'Japanese',\n",
|
||
" 'context': Submitting country Film title used in nomination Language ( s ) \\\n",
|
||
"0 Argentina The Official Story Spanish \n",
|
||
"1 Austria Malambo German \n",
|
||
"2 Belgium Dust French \n",
|
||
"3 Canada Jacques and November French \n",
|
||
"4 Czechoslovakia Scalpel , Please Czech \n",
|
||
"5 Denmark Twist and Shout Danish \n",
|
||
"6 France Three Men and a Cradle French \n",
|
||
"7 West Germany Angry Harvest German \n",
|
||
"8 Hungary Colonel Redl German \n",
|
||
"9 Iceland Deep Winter Icelandic \n",
|
||
"10 India Saagar Hindi \n",
|
||
"11 Israel When Night Falls Hebrew \n",
|
||
"12 Italy Macaroni Italian \n",
|
||
"13 Japan Gray Sunset Japanese \n",
|
||
"14 South Korea Eoudong Korean \n",
|
||
"15 Mexico Frida Still Life Spanish \n",
|
||
"16 Netherlands The Dream Dutch , West Frisian \n",
|
||
"17 Norway Wives - Ten Years After Norwegian \n",
|
||
"18 Peru The City and the Dogs Spanish \n",
|
||
"19 Philippines This Is My Country Tagalog \n",
|
||
"\n",
|
||
" Original title Director ( s ) \\\n",
|
||
"0 La Historia oficial Luis Puenzo \n",
|
||
"1 Malambo Milan Dor \n",
|
||
"2 Dust Marion Hänsel \n",
|
||
"3 Jacques et novembre Jean Beaudry and François Bouvier \n",
|
||
"4 Skalpel , prosím Jirí Svoboda \n",
|
||
"5 Tro , håb og kærlighed Bille August \n",
|
||
"6 Trois hommes et un couffin Coline Serreau \n",
|
||
"7 Bittere Ernte Agnieszka Holland \n",
|
||
"8 Oberst Redl István Szabó \n",
|
||
"9 Skammdegi Þráinn Bertelsson \n",
|
||
"10 सागर Ramesh Sippy \n",
|
||
"11 עד סוף הלילה Eitan Green \n",
|
||
"12 Maccheroni Ettore Scola \n",
|
||
"13 花いちもんめ Shunya Ito \n",
|
||
"14 어우동 Lee Jang-ho \n",
|
||
"15 Frida , naturaleza viva Paul Leduc \n",
|
||
"16 De Dream Pieter Verhoeff \n",
|
||
"17 Hustruer - ti år etter Anja Breien \n",
|
||
"18 La ciudad y los perros Francisco José Lombardi \n",
|
||
"19 Bayan ko : Kapit sa patalim Lino Brocka \n",
|
||
"\n",
|
||
" Result \n",
|
||
"0 Won Academy Award \n",
|
||
"1 Not Nominated \n",
|
||
"2 Not Nominated \n",
|
||
"3 Not Nominated \n",
|
||
"4 Not Nominated \n",
|
||
"5 Not Nominated \n",
|
||
"6 Nominated \n",
|
||
"7 Nominated \n",
|
||
"8 Nominated \n",
|
||
"9 Not Nominated \n",
|
||
"10 Not Nominated \n",
|
||
"11 Not Nominated \n",
|
||
"12 Not Nominated \n",
|
||
"13 Not Nominated \n",
|
||
"14 Not Nominated \n",
|
||
"15 Not Nominated \n",
|
||
"16 Not Nominated \n",
|
||
"17 Not Nominated \n",
|
||
"18 Not Nominated \n",
|
||
"19 Not Nominated },\n",
|
||
" { 'answer': 'Japanese',\n",
|
||
" 'context': Submitting country Film title used in nomination Language ( s ) \\\n",
|
||
"0 Argentina The Official Story Spanish \n",
|
||
"1 Austria Malambo German \n",
|
||
"2 Belgium Dust French \n",
|
||
"3 Canada Jacques and November French \n",
|
||
"4 Czechoslovakia Scalpel , Please Czech \n",
|
||
"5 Denmark Twist and Shout Danish \n",
|
||
"6 France Three Men and a Cradle French \n",
|
||
"7 West Germany Angry Harvest German \n",
|
||
"8 Hungary Colonel Redl German \n",
|
||
"9 Iceland Deep Winter Icelandic \n",
|
||
"10 India Saagar Hindi \n",
|
||
"11 Israel When Night Falls Hebrew \n",
|
||
"12 Italy Macaroni Italian \n",
|
||
"13 Japan Gray Sunset Japanese \n",
|
||
"14 South Korea Eoudong Korean \n",
|
||
"15 Mexico Frida Still Life Spanish \n",
|
||
"16 Netherlands The Dream Dutch , West Frisian \n",
|
||
"17 Norway Wives - Ten Years After Norwegian \n",
|
||
"18 Peru The City and the Dogs Spanish \n",
|
||
"19 Philippines This Is My Country Tagalog \n",
|
||
"\n",
|
||
" Original title Director ( s ) \\\n",
|
||
"0 La Historia oficial Luis Puenzo \n",
|
||
"1 Malambo Milan Dor \n",
|
||
"2 Dust Marion Hänsel \n",
|
||
"3 Jacques et novembre Jean Beaudry and François Bouvier \n",
|
||
"4 Skalpel , prosím Jirí Svoboda \n",
|
||
"5 Tro , håb og kærlighed Bille August \n",
|
||
"6 Trois hommes et un couffin Coline Serreau \n",
|
||
"7 Bittere Ernte Agnieszka Holland \n",
|
||
"8 Oberst Redl István Szabó \n",
|
||
"9 Skammdegi Þráinn Bertelsson \n",
|
||
"10 सागर Ramesh Sippy \n",
|
||
"11 עד סוף הלילה Eitan Green \n",
|
||
"12 Maccheroni Ettore Scola \n",
|
||
"13 花いちもんめ Shunya Ito \n",
|
||
"14 어우동 Lee Jang-ho \n",
|
||
"15 Frida , naturaleza viva Paul Leduc \n",
|
||
"16 De Dream Pieter Verhoeff \n",
|
||
"17 Hustruer - ti år etter Anja Breien \n",
|
||
"18 La ciudad y los perros Francisco José Lombardi \n",
|
||
"19 Bayan ko : Kapit sa patalim Lino Brocka \n",
|
||
"\n",
|
||
" Result \n",
|
||
"0 Won Academy Award \n",
|
||
"1 Not Nominated \n",
|
||
"2 Not Nominated \n",
|
||
"3 Not Nominated \n",
|
||
"4 Not Nominated \n",
|
||
"5 Not Nominated \n",
|
||
"6 Nominated \n",
|
||
"7 Nominated \n",
|
||
"8 Nominated \n",
|
||
"9 Not Nominated \n",
|
||
"10 Not Nominated \n",
|
||
"11 Not Nominated \n",
|
||
"12 Not Nominated \n",
|
||
"13 Not Nominated \n",
|
||
"14 Not Nominated \n",
|
||
"15 Not Nominated \n",
|
||
"16 Not Nominated \n",
|
||
"17 Not Nominated \n",
|
||
"18 Not Nominated \n",
|
||
"19 Not Nominated },\n",
|
||
" { 'answer': '2012',\n",
|
||
" 'context': Title Year \\\n",
|
||
"0 The American Scream 2012 \n",
|
||
"1 Dead Souls 2012 \n",
|
||
"2 Ghoul 2012 \n",
|
||
"3 Beneath 2013 \n",
|
||
"4 Chilling Visions : 5 Senses of Fear 2013 \n",
|
||
"5 The Monkey 's Paw 2013 \n",
|
||
"6 Animal 2014 \n",
|
||
"7 Deep in the Darkness 2014 \n",
|
||
"8 The Boy 2015 \n",
|
||
"9 SiREN 2016 \n",
|
||
"10 Camera Obscura 2017 \n",
|
||
"11 Dementia 13 2017 \n",
|
||
"\n",
|
||
" Production Co \n",
|
||
"0 Chiller Films Brainstorm Media \n",
|
||
"1 Chiller Films Synthetic Productions \n",
|
||
"2 Chiller Films Modernciné \n",
|
||
"3 Glass Eye Pix \n",
|
||
"4 Chiller Films Synthetic Cinema International \n",
|
||
"5 TMP Films \n",
|
||
"6 Flower Films Synthetic Cinema International \n",
|
||
"7 Chiller Films Synthetic Cinema International \n",
|
||
"8 SpectreVision \n",
|
||
"9 Studio71 \n",
|
||
"10 Chiller Films Hood River Entertainment Paper Street Pictures \n",
|
||
"11 Pipeline Entertainment Haloran LLC }]\n"
|
||
]
|
||
}
|
||
],
|
||
"source": [
|
||
"# We can see both text passages and tables as contexts of the predicted answers.\n",
|
||
"print_answers(predictions, details=\"minimum\")"
|
||
]
|
||
},
|
||
{
|
||
"cell_type": "markdown",
|
||
"metadata": {},
|
||
"source": [
|
||
"## Evaluation\n",
|
||
"To evaluate our pipeline, we can use haystack's evaluation feature. We just need to convert our labels into `MultiLabel` objects and the `eval` method will do the rest."
|
||
]
|
||
},
|
||
{
|
||
"cell_type": "code",
|
||
"execution_count": 25,
|
||
"metadata": {},
|
||
"outputs": [],
|
||
"source": [
|
||
"from haystack import Label, MultiLabel, Answer\n",
|
||
"\n",
|
||
"\n",
|
||
"def read_labels(filename, tables):\n",
|
||
" processed_labels = []\n",
|
||
" with open(filename) as labels:\n",
|
||
" labels = json.load(labels)\n",
|
||
" for table in tables:\n",
|
||
" if table.id not in labels:\n",
|
||
" continue\n",
|
||
" label = labels[table.id]\n",
|
||
" label = Label(\n",
|
||
" query=label[\"query\"],\n",
|
||
" document=table,\n",
|
||
" is_correct_answer=True,\n",
|
||
" is_correct_document=True,\n",
|
||
" answer=Answer(answer=label[\"answer\"]),\n",
|
||
" origin=\"gold-label\",\n",
|
||
" )\n",
|
||
" processed_labels.append(MultiLabel(labels=[label]))\n",
|
||
" return processed_labels\n",
|
||
"\n",
|
||
"\n",
|
||
"table_labels = read_labels(f\"{doc_dir}/labels.json\", tables)\n",
|
||
"passage_labels = read_labels(f\"{doc_dir}/labels.json\", passages)"
|
||
]
|
||
},
|
||
{
|
||
"cell_type": "code",
|
||
"execution_count": null,
|
||
"metadata": {},
|
||
"outputs": [],
|
||
"source": [
|
||
"eval_results = text_table_qa_pipeline.eval(table_labels + passage_labels, params={\"top_k\": 10})"
|
||
]
|
||
},
|
||
{
|
||
"cell_type": "code",
|
||
"execution_count": 27,
|
||
"metadata": {},
|
||
"outputs": [
|
||
{
|
||
"name": "stdout",
|
||
"output_type": "stream",
|
||
"text": [
|
||
"{'JoinAnswers': {'f1': 0.7135714285714286, 'exact_match': 0.6}}\n"
|
||
]
|
||
}
|
||
],
|
||
"source": [
|
||
"# Calculating and printing the evaluation metrics\n",
|
||
"print(eval_results.calculate_metrics())"
|
||
]
|
||
},
|
||
{
|
||
"cell_type": "markdown",
|
||
"metadata": {},
|
||
"source": [
|
||
"## Adding tables from PDFs\n",
|
||
"It can sometimes be hard to provide your data in form of a pandas DataFrame. For this case, we provide the `ParsrConverter` wrapper that can help you to convert, for example, a PDF file into a document that you can index.\n",
|
||
"\n",
|
||
"**Attention: `parsr` needs a docker environment for execution, but Colab doesn't support docker.**\n",
|
||
"**If you have a local docker environment, you can uncomment and run the following cells.**"
|
||
]
|
||
},
|
||
{
|
||
"cell_type": "code",
|
||
"execution_count": null,
|
||
"metadata": {},
|
||
"outputs": [],
|
||
"source": [
|
||
"# import time\n",
|
||
"\n",
|
||
"# !docker run -d -p 3001:3001 axarev/parsr\n",
|
||
"# time.sleep(30)"
|
||
]
|
||
},
|
||
{
|
||
"cell_type": "code",
|
||
"execution_count": null,
|
||
"metadata": {},
|
||
"outputs": [],
|
||
"source": [
|
||
"# !wget https://www.w3.org/WAI/WCAG21/working-examples/pdf-table/table.pdf"
|
||
]
|
||
},
|
||
{
|
||
"cell_type": "code",
|
||
"execution_count": 32,
|
||
"metadata": {},
|
||
"outputs": [],
|
||
"source": [
|
||
"# from haystack.nodes import ParsrConverter\n",
|
||
"\n",
|
||
"# converter = ParsrConverter()\n",
|
||
"\n",
|
||
"# docs = converter.convert(\"table.pdf\")\n",
|
||
"\n",
|
||
"# tables = [doc for doc in docs if doc.content_type == \"table\"]"
|
||
]
|
||
},
|
||
{
|
||
"cell_type": "code",
|
||
"execution_count": 34,
|
||
"metadata": {},
|
||
"outputs": [
|
||
{
|
||
"name": "stdout",
|
||
"output_type": "stream",
|
||
"text": [
|
||
"[{'content': [['Disability\\nCategory', 'Participants', 'Ballots\\nCompleted', 'Ballots\\nIncomplete/\\nTerminated', 'Results', 'Results'], ['Disability\\nCategory', 'Participants', 'Ballots\\nCompleted', 'Ballots\\nIncomplete/\\nTerminated', 'Accuracy', 'Time to\\ncomplete'], ['Blind', '5', '1', '4', '34.5%, n=1', '1199 sec, n=1'], ['Low Vision', '5', '2', '3', '98.3% n=2\\n(97.7%, n=3)', '1716 sec, n=3\\n(1934 sec, n=2)'], ['Dexterity', '5', '4', '1', '98.3%, n=4', '1672.1 sec, n=4'], ['Mobility', '3', '3', '0', '95.4%, n=3', '1416 sec, n=3']], 'content_type': 'table', 'meta': {'preceding_context': 'Example table\\nThis is an example of a data table.', 'following_context': ''}}]\n"
|
||
]
|
||
}
|
||
],
|
||
"source": [
|
||
"# print(tables)"
|
||
]
|
||
},
|
||
{
|
||
"cell_type": "markdown",
|
||
"metadata": {
|
||
"id": "RyeK3s28_X1C"
|
||
},
|
||
"source": [
|
||
"## About us\n",
|
||
"\n",
|
||
"This [Haystack](https://github.com/deepset-ai/haystack/) notebook was made with love by [deepset](https://deepset.ai/) in Berlin, Germany\n",
|
||
"\n",
|
||
"We bring NLP to the industry via open source! \n",
|
||
"Our focus: Industry specific language models & large scale QA systems. \n",
|
||
" \n",
|
||
"Some of our other work: \n",
|
||
"- [German BERT](https://deepset.ai/german-bert)\n",
|
||
"- [GermanQuAD and GermanDPR](https://deepset.ai/germanquad)\n",
|
||
"- [FARM](https://github.com/deepset-ai/FARM)\n",
|
||
"\n",
|
||
"Get in touch:\n",
|
||
"[Twitter](https://twitter.com/deepset_ai) | [LinkedIn](https://www.linkedin.com/company/deepset-ai/) | [Slack](https://haystack.deepset.ai/community/join) | [GitHub Discussions](https://github.com/deepset-ai/haystack/discussions) | [Website](https://deepset.ai)\n",
|
||
"\n",
|
||
"By the way: [we're hiring!](https://www.deepset.ai/jobs)\n"
|
||
]
|
||
}
|
||
],
|
||
"metadata": {
|
||
"accelerator": "GPU",
|
||
"colab": {
|
||
"name": "Tutorial15_TableQA.ipynb",
|
||
"provenance": []
|
||
},
|
||
"kernelspec": {
|
||
"display_name": "Python 3",
|
||
"name": "python3"
|
||
},
|
||
"language_info": {
|
||
"codemirror_mode": {
|
||
"name": "ipython",
|
||
"version": 3
|
||
},
|
||
"file_extension": ".py",
|
||
"mimetype": "text/x-python",
|
||
"name": "python",
|
||
"nbconvert_exporter": "python",
|
||
"pygments_lexer": "ipython3",
|
||
"version": "3.9.7"
|
||
}
|
||
},
|
||
"nbformat": 4,
|
||
"nbformat_minor": 0
|
||
}
|