Update README.md (#702)

Typo in kv cache readme
This commit is contained in:
Shamik 2025-06-23 17:51:51 +05:30 committed by GitHub
parent f3fadd6c0a
commit f051a5fe6b

View File

@ -104,7 +104,7 @@ def reset_cache(self):
### 4. Propagating `use_cache` in the full model
With the changes to the `MultiHeadAttention` class in plass, we now modify the `GPTModel` class. First, we add a position tracking for the token indices to the instructor:
With the changes to the `MultiHeadAttention` class in place, we now modify the `GPTModel` class. First, we add a position tracking for the token indices to the instructor:
```python
self.current_pos = 0