yujunjun/LLMs-from-scratch
1
0
Fork 0
mirror of https://github.com/rasbt/LLMs-from-scratch.git synced 2025-08-15 20:21:22 +00:00
Code Issues Packages Projects Releases Wiki Activity
LLMs-from-scratch/ch04/01_main-chapter-code
History
Jeroen Van Goey 48bd72c890
fix typos, add codespell pre-commit hook (#264) 
* fix typos, add codespell pre-commit hook

* Update .pre-commit-config.yaml

---------

Co-authored-by: Sebastian Raschka <mail@sebastianraschka.com>
2024-07-16 07:07:04 -05:00
..
ch04.ipynb
fix typos, add codespell pre-commit hook (#264)
2024-07-16 07:07:04 -05:00
exercise-solutions.ipynb
fixes for code (#206)
2024-06-11 20:59:48 -05:00
gpt.py
fixed num_workers (#229)
2024-06-19 17:36:46 -05:00
previous_chapters.py
fixed num_workers (#229)
2024-06-19 17:36:46 -05:00
README.md
add main and optional sections
2024-06-19 17:48:25 -05:00
tests.py
Ch05 supplementary code (#81)
2024-03-19 09:26:26 -05:00

README.md

Chapter 4: Implementing a GPT Model from Scratch To Generate Text

Main Chapter Code

  • ch04.ipynb contains all the code as it appears in the chapter
  • previous_chapters.py is a Python module that contains the MultiHeadAttention module from the previous chapter, which we import in ch04.ipynb to create the GPT model

Optional Code

  • gpt.py is a standalone Python script file with the code that we implemented thus far, including the GPT model we coded in this chapter