mirror of https://github.com/rasbt/LLMs-from-scratch.git synced 2025-10-31 09:50:23 +00:00

History

Sebastian Raschka fcf8bcab0d Remove duplicated cell (#212 )

* add a suggestion since code snippet has been repeated.

* remove duplicated cell

---------

Co-authored-by: Shuyib <benmainye@gmail.com>

2024-06-15 12:48:34 -05:00

ch05.ipynb

2024-06-15 12:48:34 -05:00

exercise-solutions.ipynb

update formatting

2024-05-24 07:20:37 -05:00

gpt_download.py

fix merge conflict

2024-04-22 07:05:40 -05:00

gpt_generate.py

change defaults to 0 temp

2024-05-19 09:04:49 -05:00

gpt_train.py

fix typo in comment

2024-06-09 06:14:02 -05:00

previous_chapters.py

2024-06-08 14:57:34 -05:00

README.md

add readme

2024-05-13 08:50:55 -05:00

tests.py

check gpt files (#208 )

2024-06-12 07:19:10 -05:00

Chapter 5: Pretraining on Unlabeled Data

ch05.ipynb contains all the code as it appears in the chapter
previous_chapters.py is a Python module that contains the MultiHeadAttention module and GPTModel class from the previous chapters, which we import in ch05.ipynb to pretrain the GPT model
gpt_train.py is a standalone Python script file with the code that we implemented in ch05.ipynb to train the GPT model (you can think of it as a code file summarizing this chapter)
gpt_generate.py is a standalone Python script file with the code that we implemented in ch05.ipynb to load and use the pretrained model weights from OpenAI
gpt_download.py contains the utility functions for downloading the pretrained GPT model weights
exercise-solutions.ipynb contains the exercise solutions for this chapter