yujunjun/LLMs-from-scratch
1
0
Fork 0
mirror of https://github.com/rasbt/LLMs-from-scratch.git synced 2025-10-10 23:49:33 +00:00
Code Issues Packages Projects Releases Wiki Activity

the above -> the following

Browse Source
This commit is contained in:
Intelligence-Manifesto 2024-03-15 05:00:28 +08:00 committed by GitHub
parent ee8efcbcf6
commit d4b4e3d0f0
1 changed files with 1 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2
ch03/01_main-chapter-code/ch03.ipynb
View File

@ -1734,7 +1734,7 @@
"source": [ "source": [
"- In this case, the matrix multiplication implementation in PyTorch will handle the 4-dimensional input tensor so that the matrix multiplication is carried out between the 2 last dimensions (num_tokens, head_dim) and then repeated for the individual heads. \n", "- In this case, the matrix multiplication implementation in PyTorch will handle the 4-dimensional input tensor so that the matrix multiplication is carried out between the 2 last dimensions (num_tokens, head_dim) and then repeated for the individual heads. \n",
"\n", "\n",
"- For instance, the above becomes a more compact way to compute the matrix multiplication for each head separately:" "- For instance, the following becomes a more compact way to compute the matrix multiplication for each head separately:"
] ]
}, },
{ {