yujunjun/LLMs-from-scratch
1
0
Fork 0
mirror of https://github.com/rasbt/LLMs-from-scratch.git synced 2025-12-02 18:10:37 +00:00
Code Issues Packages Projects Releases Wiki Activity

fix code comment (#834)

Browse Source
This commit is contained in:
Synix 2025-09-17 09:36:02 +08:00 committed by GitHub
parent b6cd0a312f
commit bfc6389fab
No known key found for this signature in database
GPG Key ID: B5690EEEBB952194
1 changed files with 1 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2
ch03/01_main-chapter-code/ch03.ipynb
View File

@ -1844,7 +1844,7 @@
" # As in `CausalAttention`, for inputs where `num_tokens` exceeds `context_length`, \n",
" # this will result in errors in the mask creation further below. \n",
" # In practice, this is not a problem since the LLM (chapters 4-7) ensures that inputs \n",
" # do not exceed `context_length` before reaching this forwar\n",
" # do not exceed `context_length` before reaching this forward method.\n",
"\n",
" keys = self.W_key(x) # Shape: (b, num_tokens, d_out)\n",
" queries = self.W_query(x)\n",