yujunjun/LLMs-from-scratch
1
0
Fork 0
mirror of https://github.com/rasbt/LLMs-from-scratch.git synced 2025-08-31 12:00:23 +00:00
Code Issues Packages Projects Releases Wiki Activity
LLMs-from-scratch/ch04
History
Sebastian Raschka 68e2efe1c9
Mention small discrepancy due to Dropout non-reproducibility in PyTorch (#519) 
* Mention small discrepancy due to Dropout non-reproducibility in PyTorch

* bump pytorch version
2025-02-06 14:59:52 -06:00
..
01_main-chapter-code
Mention small discrepancy due to Dropout non-reproducibility in PyTorch (#519)
2025-02-06 14:59:52 -06:00
02_performance-analysis
update card
2024-10-11 12:15:01 -05:00
README.md
Update bonus section formatting (#400)
2024-10-12 10:26:08 -05:00

README.md

Chapter 4: Implementing a GPT Model from Scratch to Generate Text

 

Main Chapter Code

 

Bonus Materials

  • 02_performance-analysis contains optional code analyzing the performance of the GPT model(s) implemented in the main chapter
  • ch05/07_gpt_to_llama contains a step-by-step guide for converting a GPT architecture implementation to Llama 3.2 and loads pretrained weights from Meta AI (it might be interesting to look at alternative architectures after completing chapter 4, but you can also save that for after reading chapter 5)