Sebastian Raschka aa5851914f Merge pull request #4 from rasbt/ch03
add ch03 and TOC
2023-12-09 17:14:56 -06:00
2023-12-09 17:13:56 -06:00
2023-10-25 18:46:40 -05:00
2023-12-09 17:13:56 -06:00
2023-12-09 17:13:56 -06:00
2023-12-09 17:13:56 -06:00
2023-07-23 13:18:13 -05:00
2023-12-05 18:45:47 -06:00
2023-12-09 17:13:56 -06:00

Large Language Models from Scratch

Details will follow ...

Table of Contents

Chapter Main code Code + supplementary
Ch 1: Understanding Large Language Models No code No code
Ch 2: Working with Text Data ch02.ipynb
dataloader.ipynb
./ch02
Ch 3: Understanding Attention Mechanisms ch03.ipynb
multihead-attention.ipynb
./ch03
... ... ...
Appendix A: Introduction to PyTorch code-part1.ipynb
code-part2.ipynb
DDP-script.py
./appendix-A
Description
Implement a ChatGPT-like LLM in PyTorch from scratch, step by step
Readme 23 MiB
Languages
Jupyter Notebook 76.2%
Python 23.8%