yujunjun/LLMs-from-scratch
1
0
Fork 0
mirror of https://github.com/rasbt/LLMs-from-scratch.git synced 2025-11-03 19:30:26 +00:00
Code Issues Packages Projects Releases Wiki Activity

update attention benchmarks (#307)

Browse Source
This commit is contained in:
Sebastian Raschka 2024-08-10 09:44:11 -05:00 committed by GitHub
parent 7feb8cad86
commit 3f6652d87e
No known key found for this signature in database
GPG Key ID: B5690EEEBB952194
2 changed files with 1841 additions and 87 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

4
ch03/02_bonus_efficient-multihead-attention/README.md
View File

@ -1,3 +1,5 @@
# More Efficient Multi-Head Attention Implementations
- [mha-implementations.ipynb](mha-implementations.ipynb) contains and compares different implementations of multi-head attention
- [mha-implementations.ipynb](mha-implementations.ipynb) contains and compares different implementations of multi-head attention
<a href="mha-implementations.ipynb"><img src="https://sebastianraschka.com/images/LLMs-from-scratch-images/bonus/mha-benchmark/mha-comparison.webp" width="500px"></a>

1924
ch03/02_bonus_efficient-multihead-attention/mha-implementations.ipynb
View File

File diff suppressed because one or more lines are too long