mirror of
https://github.com/rasbt/LLMs-from-scratch.git
synced 2025-08-30 03:20:51 +00:00
4 lines
201 B
Markdown
4 lines
201 B
Markdown
|
# Byte Pair Encoding (BPE) Tokenizer From Scratch
|
||
|
|
|
||
|
|
- [bpe-from-scratch.ipynb](bpe-from-scratch.ipynb) contains optional (bonus) code that explains and shows how the BPE tokenizer works under the hood.
|