3 Commits

Author SHA1 Message Date
Sebastian Raschka
58b30e2f7b Improve KV cache code for torch.compile (#705)
* Improve KV cache code for torch.compile

* cleanup

* cleanup
2025-06-23 18:08:49 -05:00
Sebastian Raschka
c488578cae Optimize KV cache (#673)
* Optimize KV cache

* style

* interpretable generate

* interpretable generate

* update readme
2025-06-16 16:00:50 -05:00
Sebastian Raschka
9aed6f5a76 Add KV cache (#671) 2025-06-15 09:58:08 -05:00