LLMs-from-scratch/ch04/01_main-chapter-code/README.md

# Chapter 4: Implementing a GPT Model from Scratch To Generate Text

### Main Chapter Code

- [ch04.ipynb](ch04.ipynb) contains all the code as it appears in the chapter
- [previous_chapters.py](previous_chapters.py) is a Python module that contains the `MultiHeadAttention` module from the previous chapter, which we import in [ch04.ipynb](ch04.ipynb) to create the GPT model

### Optional Code

- [gpt.py](gpt.py) is a standalone Python script file with the code that we implemented thus far, including the GPT model we coded in this chapter
flops analysis 2024-05-23 20:35:41 -05:00			`# Chapter 4: Implementing a GPT Model from Scratch To Generate Text`
add and update readme files 2024-02-05 06:51:58 -06:00
add main and optional sections 2024-06-19 17:48:25 -05:00			`### Main Chapter Code`

add and update readme files 2024-02-05 06:51:58 -06:00			`- [ch04.ipynb](ch04.ipynb) contains all the code as it appears in the chapter`
			- [previous_chapters.py](previous_chapters.py) is a Python module that contains the `MultiHeadAttention` module from the previous chapter, which we import in [ch04.ipynb](ch04.ipynb) to create the GPT model
add main and optional sections 2024-06-19 17:48:25 -05:00
			`### Optional Code`

add and update readme files 2024-02-05 06:51:58 -06:00			`- [gpt.py](gpt.py) is a standalone Python script file with the code that we implemented thus far, including the GPT model we coded in this chapter`