yujunjun/LLMs-from-scratch
1
0
Fork 0
mirror of https://github.com/rasbt/LLMs-from-scratch.git synced 2025-06-26 23:50:03 +00:00
Code Issues Packages Projects Releases Wiki Activity
LLMs-from-scratch/ch04/01_main-chapter-code
History
Sebastian Raschka c9dccb0c40 Merge pull request #33 from rayedbw/patch-1 
Update ch04.ipynb
2024-02-29 20:00:09 -06:00
..
figures
use smaller number of tokens to emphasize next token prediction goal
2024-02-15 20:09:20 -06:00
ch04.ipynb
remove redundant import
2024-02-29 19:59:05 -06:00
exercise-solutions.ipynb
rearrange exercise order
2024-02-11 14:46:05 -06:00
gpt.py
remove redundant double-unsequeeze
2024-02-29 08:31:07 -06:00
previous_chapters.py
remove redundant double-unsequeeze
2024-02-29 08:31:07 -06:00
README.md
add and update readme files
2024-02-05 06:51:58 -06:00

README.md

Chapter 4: Implementing a GPT model from Scratch To Generate Text

  • ch04.ipynb contains all the code as it appears in the chapter
  • previous_chapters.py is a Python module that contains the MultiHeadAttention module from the previous chapter, which we import in ch04.ipynb to create the GPT model
  • gpt.py is a standalone Python script file with the code that we implemented thus far, including the GPT model we coded in this chapter