yujunjun/LLMs-from-scratch
1
0
Fork 0
mirror of https://github.com/rasbt/LLMs-from-scratch.git synced 2025-08-30 19:41:51 +00:00
Code Issues Packages Projects Releases Wiki Activity
906 Commits 9 Branches 0 Tags
Commit Graph

3 Commits

Author SHA1 Message Date
Martin Ma
6522be94be
Fix bug in masking when kv cache is used. (#697) 
* Fix bug in masking when kv cache is used.

* add tests

* dd tests

* upd

* add kv cache test to gh workflow

* explicit mask slicing

* upd

---------

Co-authored-by: rasbt <mail@sebastianraschka.com>
 2025-06-23 13:12:56 -05:00
Sebastian Raschka
ece59ba587
Optimize KV cache (#673) 
* Optimize KV cache

* style

* interpretable generate

* interpretable generate

* update readme
 2025-06-16 16:00:50 -05:00
Sebastian Raschka
2af686d70b
Add KV cache (#671) 2025-06-15 09:58:08 -05:00