yujunjun/LLMs-from-scratch
1
0
Fork 0
mirror of https://github.com/rasbt/LLMs-from-scratch.git synced 2025-11-17 10:34:50 +00:00
Code Issues Packages Projects Releases Wiki Activity

add performance of llama 3 models for reference

Browse Source
This commit is contained in:
rasbt 2024-06-10 18:21:58 -05:00
parent 9a81230968
commit cbbd4c5600
1 changed files with 11 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

12
ch07/01_main-chapter-code/ch07.ipynb
View File

@ -1734,6 +1734,16 @@
"print(f\"Average score: {sum(scores)/len(scores):.2f}\\n\")" "print(f\"Average score: {sum(scores)/len(scores):.2f}\\n\")"
] ]
}, },
{
"cell_type": "markdown",
"id": "e95ac0db-aa58-43eb-8e6e-6ea8ae798299",
"metadata": {},
"source": [
"- For reference, the original\n",
" - Llama 3 8B base model achieves a score of 58.51\n",
" - Llama 3 8B instruct model achieves a score of 82.65"
]
},
{ {
"cell_type": "markdown", "cell_type": "markdown",
"id": "412d7325-284a-446c-92a1-5aa8acc52dee", "id": "412d7325-284a-446c-92a1-5aa8acc52dee",
@ -1775,7 +1785,7 @@
"name": "python", "name": "python",
"nbconvert_exporter": "python", "nbconvert_exporter": "python",
"pygments_lexer": "ipython3", "pygments_lexer": "ipython3",
"version": "3.10.12" "version": "3.10.6"
} }
}, },
"nbformat": 4, "nbformat": 4,