yujunjun/LLMs-from-scratch
1
0
Fork 0
mirror of https://github.com/rasbt/LLMs-from-scratch.git synced 2025-12-04 11:00:38 +00:00
Code Issues Packages Projects Releases Wiki Activity
LLMs-from-scratch/ch03/02_bonus_efficient-multihead-attention/README.md

5 lines
351 B
Markdown
Raw Normal View History

mha variants
2024-03-06 08:30:32 -06:00
# More Efficient Multi-Head Attention Implementations
update attention benchmarks (#307)
2024-08-10 09:44:11 -05:00
- [mha-implementations.ipynb](mha-implementations.ipynb) contains and compares different implementations of multi-head attention
<a href="mha-implementations.ipynb"><img src="https://sebastianraschka.com/images/LLMs-from-scratch-images/bonus/mha-benchmark/mha-comparison.webp" width="500px"></a>
Reference in New Issue Copy Permalink