LLMs-from-scratch/ch02/03_bonus_embedding-vs-matmul

Chapter 2: Working with Text Data

  • embeddings-and-linear-layers.ipynb contains optional (bonus) code to explain that embedding layers and fully connected layers applied to one-hot encoded vectors are equivalent.