6 Commits

Author	SHA1	Message	Date
rasbt	713a6e24c9	add tests	2025-06-22 17:48:23 -05:00
martinzwm	ffc5e4e5d6	Fix bug in masking when kv cache is used.	2025-06-22 14:06:00 -07:00
Sebastian Raschka	fdc3e1b701	Add GPT-2 KV cache to pkg (#687)	2025-06-21 12:29:04 -05:00
Sebastian Raschka	ece59ba587	Optimize KV cache (#673) ... * Optimize KV cache * style * interpretable generate * interpretable generate * update readme	2025-06-16 16:00:50 -05:00
Sebastian Raschka	ba0370abd1	Optimized KV cache (#672) ... * Optimized KV cache * typo fix	2025-06-15 14:26:16 -05:00
Sebastian Raschka	2af686d70b	Add KV cache (#671)	2025-06-15 09:58:08 -05:00