mirror of
https://github.com/rasbt/LLMs-from-scratch.git
synced 2025-10-28 16:30:07 +00:00
0b866c133f
* Use instance tokenizer * consistency updates --------- Co-authored-by: Sebastian Raschka <mail@sebastianraschka.com>
Chapter 2: Working with Text Data
-
01_main-chapter-code contains the main chapter code and exercise solutions
-
02_bonus_bytepair-encoder contains optional code to benchmark different byte pair encoder implementations
-
03_bonus_embedding-vs-matmul contains optional (bonus) code to explain that embedding layers and fully connected layers applied to one-hot encoded vectors are equivalent.