yujunjun/LLMs-from-scratch
1
0
Fork 0
mirror of https://github.com/rasbt/LLMs-from-scratch.git synced 2025-11-02 19:00:14 +00:00
Code Issues Packages Projects Releases Wiki Activity

add performance of llama 3 models for reference

Browse Source
This commit is contained in:
rasbt 2024-06-10 18:21:58 -05:00
parent 9a81230968
commit cbbd4c5600
1 changed files with 11 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

12
ch07/01_main-chapter-code/ch07.ipynb
View File

@ -1734,6 +1734,16 @@
"print(f\"Average score: {sum(scores)/len(scores):.2f}\\n\")"
]
},
{
"cell_type": "markdown",
"id": "e95ac0db-aa58-43eb-8e6e-6ea8ae798299",
"metadata": {},
"source": [
"- For reference, the original\n",
" - Llama 3 8B base model achieves a score of 58.51\n",
" - Llama 3 8B instruct model achieves a score of 82.65"
]
},
{
"cell_type": "markdown",
"id": "412d7325-284a-446c-92a1-5aa8acc52dee",
@ -1775,7 +1785,7 @@
"name": "python",
"nbconvert_exporter": "python",
"pygments_lexer": "ipython3",
"version": "3.10.12"
"version": "3.10.6"
}
},
"nbformat": 4,