diff --git a/README.md b/README.md index 0f118d8..ebbb298 100644 --- a/README.md +++ b/README.md @@ -19,21 +19,20 @@ The method described in this book for training and developing your own small-but

-## Table of Contents + +# Table of Contents Please note that the `Readme.md` file is a Markdown (`.md`) file. If you have downloaded this code bundle from the Manning website and are viewing it on your local computer, I recommend using a Markdown editor or previewer for proper viewing. If you haven't installed a Markdown editor yet, MarkText[https://www.marktext.cc](https://www.marktext.cc) is a good free option. Alternatively, you can view this and other files on GitHub at [https://github.com/rasbt/LLMs-from-scratch](https://github.com/rasbt/LLMs-from-scratch). - - -| Chapter | Main code | Code + supplementary | +| Chapter title | Main code | Code + supplementary | | ----------------------------------------- | ------------------------------------------------------------ | ---------------------------- | | Ch 1: Understanding Large Language Models | No code | No code | -| Ch 2: Working with Text Data | [ch02.ipynb](ch02/01_main-chapter-code/ch02.ipynb)
[dataloader.ipynb](ch02/01_main-chapter-code/dataloader.ipynb) | [./ch02](./ch02) | -| Ch 3: Understanding Attention Mechanisms | [ch03.ipynb](ch03/01_main-chapter-code/ch03.ipynb)
[multihead-attention.ipynb](ch03/01_main-chapter-code/multihead-attention.ipynb) | [./ch03](./ch03) | +| Ch 2: Working with Text Data | All chapter code: [ch02.ipynb](ch02/01_main-chapter-code/ch02.ipynb)
Chapter takeaway: [dataloader.ipynb](ch02/01_main-chapter-code/dataloader.ipynb)
[exercise-solutions.ipynb](ch02/01_main-chapter-code/exercise-solutions.ipynb) | [./ch02](./ch02) | +| Ch 3: Understanding Attention Mechanisms | All chapter code: [ch03.ipynb](ch03/01_main-chapter-code/ch03.ipynb)
Chapter takeaway: [multihead-attention.ipynb](ch03/01_main-chapter-code/multihead-attention.ipynb) | [./ch03](./ch03) | | ... | ... | ... | -| Appendix A: Introduction to PyTorch | [code-part1.ipynb](03_main-chapter-code/01_main-chapter-code/code-part1.ipynb)
[code-part2.ipynb](03_main-chapter-code/01_main-chapter-code/code-part2.ipynb)
[DDP-script.py](03_main-chapter-code/01_main-chapter-code/DDP-script.py) | [./appendix-A](./appendix-A) | +| Appendix A: Introduction to PyTorch | Code up to GPU training: [code-part1.ipynb](03_main-chapter-code/01_main-chapter-code/code-part1.ipynb)
GPU training sections: [code-part2.ipynb](03_main-chapter-code/01_main-chapter-code/code-part2.ipynb)
Multi-GPU training script: [DDP-script.py](03_main-chapter-code/01_main-chapter-code/DDP-script.py)
[exercise-solutions.ipynb](https://github.com/rasbt/LLMs-from-scratch/blob/main/appendix-A/03_main-chapter-code/exercise-solutions.ipynb) | [./appendix-A](./appendix-A) |

@@ -41,3 +40,4 @@ Alternatively, you can view this and other files on GitHub at [https://github.co (A mental model summarizing the contents covered in this book.) + diff --git a/appendix-A/03_main-chapter-code/code-part1.ipynb b/appendix-A/03_main-chapter-code/code-part1.ipynb index e431c24..39e3f2e 100644 --- a/appendix-A/03_main-chapter-code/code-part1.ipynb +++ b/appendix-A/03_main-chapter-code/code-part1.ipynb @@ -1215,8 +1215,16 @@ "id": "9d049a81-5fb0-49b5-9d6a-17a9976d8520", "metadata": {}, "source": [ - "See [code-part3.py](code-part3.py)" + "See [DDP-script.py](DDP-script.py)" ] + }, + { + "cell_type": "code", + "execution_count": null, + "id": "b32db94f-f159-4aa3-91cc-5b937eef7fc7", + "metadata": {}, + "outputs": [], + "source": [] } ], "metadata": { diff --git a/ch03/01_main-chapter-code/ch03.ipynb b/ch03/01_main-chapter-code/ch03.ipynb index f5abca5..f1e54be 100644 --- a/ch03/01_main-chapter-code/ch03.ipynb +++ b/ch03/01_main-chapter-code/ch03.ipynb @@ -1823,7 +1823,7 @@ "name": "python", "nbconvert_exporter": "python", "pygments_lexer": "ipython3", - "version": "3.11.4" + "version": "3.10.6" } }, "nbformat": 4,