4 Commits

Author	SHA1	Message	Date
rasbt	713a6e24c9	add tests	2025-06-22 17:48:23 -05:00
martinzwm	ffc5e4e5d6	Fix bug in masking when kv cache is used.	2025-06-22 14:06:00 -07:00
Sebastian Raschka	ece59ba587	Optimize KV cache (#673) ... * Optimize KV cache * style * interpretable generate * interpretable generate * update readme	2025-06-16 16:00:50 -05:00
Sebastian Raschka	2af686d70b	Add KV cache (#671)	2025-06-15 09:58:08 -05:00