yujunjun/LLMs-from-scratch
1
0
Fork 0
mirror of https://github.com/rasbt/LLMs-from-scratch.git synced 2025-12-13 16:01:34 +00:00
Code Issues Packages Projects Releases Wiki Activity
901 Commits 11 Branches 0 Tags
Commit Graph

3 Commits

Author SHA1 Message Date
Martin Ma
ad16b1fbee Fix bug in masking when kv cache is used. (#697) 
* Fix bug in masking when kv cache is used.

* add tests

* dd tests

* upd

* add kv cache test to gh workflow

* explicit mask slicing

* upd

---------

Co-authored-by: rasbt <mail@sebastianraschka.com>
 2025-06-23 13:12:56 -05:00
Sebastian Raschka
c488578cae Optimize KV cache (#673) 
* Optimize KV cache

* style

* interpretable generate

* interpretable generate

* update readme
 2025-06-16 16:00:50 -05:00
Sebastian Raschka
9aed6f5a76 Add KV cache (#671) 2025-06-15 09:58:08 -05:00