mirror of https://github.com/rasbt/LLMs-from-scratch.git synced 2025-08-22 07:32:25 +00:00

History

* added std error bars

* fixed changes

* Update on A100

---------

Co-authored-by: Sebastian Raschka <mail@sebastianraschka.com>

2024-08-13 20:57:41 -05:00

2024-07-24 21:53:41 -05:00

2024-08-13 20:57:41 -05:00

Update README.md

2024-07-30 06:55:41 -05:00

README.md

2024-07-26 08:45:36 -05:00

Chapter 3: Coding Attention Mechanisms

Main Chapter Code

02_bonus_efficient-multihead-attention implements and compares different implementation variants of multihead-attention
03_understanding-buffers explains the idea behind PyTorch buffers, which are used to implement the causal attention mechanism in chapter 3