mirror of https://github.com/rasbt/LLMs-from-scratch.git synced 2025-08-15 12:12:10 +00:00

History

* fixed typo

* removed remaining nbviewer links

* Update mha-implementations.ipynb

---------

Co-authored-by: Sebastian Raschka <mail@sebastianraschka.com>

2024-09-07 07:27:28 +02:00

01_main-chapter-code

Test code in pytorch 2.4 (#285 )

2024-07-24 21:53:41 -05:00

02_bonus_efficient-multihead-attention

nbviewer links / typo (#346 )

2024-09-07 07:27:28 +02:00

03_understanding-buffers

Update README.md

2024-07-30 06:55:41 -05:00

README.md

Understanding PyTorch Buffers (#288 )

2024-07-26 08:45:36 -05:00

README.md

Chapter 3: Coding Attention Mechanisms

Main Chapter Code

01_main-chapter-code contains the main chapter code.

Bonus Materials

02_bonus_efficient-multihead-attention implements and compares different implementation variants of multihead-attention
03_understanding-buffers explains the idea behind PyTorch buffers, which are used to implement the causal attention mechanism in chapter 3