yujunjun/LLMs-from-scratch
1
0
Fork 0
mirror of https://github.com/rasbt/LLMs-from-scratch.git synced 2025-06-26 23:50:03 +00:00
Code Issues Packages Projects Releases Wiki Activity
LLMs-from-scratch/ch03/01_main-chapter-code
History
Intelligence-Manifesto 1278615c25 12 -> 21 
12 -> 21
2024-02-11 14:17:55 +08:00
..
figures
add ch03 and TOC
2023-12-09 17:13:56 -06:00
ch03.ipynb
12 -> 21
2024-02-11 14:17:55 +08:00
exercise-solutions.ipynb
small readability updates
2024-01-14 11:58:42 -06:00
multihead-attention.ipynb
<|endoftext|> token in dataset v1
2024-01-21 12:03:04 -06:00
README.md
add and update readme files
2024-02-05 06:51:58 -06:00
small-text-sample.txt
use block size variable in positional embedding layer
2023-12-28 19:05:06 +01:00

README.md

Chapter 3: Coding Attention Mechanisms

  • ch03.ipynb contains all the code as it appears in the chapter
  • multihead-attention.ipynb is a minimal notebook with the main data loading pipeline implemented in this chapter