yujunjun/LLMs-from-scratch
1
0
Fork 0
mirror of https://github.com/rasbt/LLMs-from-scratch.git synced 2025-10-31 01:41:26 +00:00
Code Issues Packages Projects Releases Wiki Activity

update attention benchmarks (#307)

Browse Source
This commit is contained in:
Sebastian Raschka 2024-08-10 09:44:11 -05:00 committed by GitHub
parent 8d79fb13b0
commit f58c2b969b
2 changed files with 1841 additions and 87 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2
ch03/02_bonus_efficient-multihead-attention/README.md
View File

@ -1,3 +1,5 @@
# More Efficient Multi-Head Attention Implementations
- [mha-implementations.ipynb](mha-implementations.ipynb) contains and compares different implementations of multi-head attention
<a href="mha-implementations.ipynb"><img src="https://sebastianraschka.com/images/LLMs-from-scratch-images/bonus/mha-benchmark/mha-comparison.webp" width="500px"></a>

1928
ch03/02_bonus_efficient-multihead-attention/mha-implementations.ipynb
View File

File diff suppressed because one or more lines are too long