yujunjun/LLMs-from-scratch
1
0
Fork 0
mirror of https://github.com/rasbt/LLMs-from-scratch.git synced 2025-08-29 19:10:19 +00:00
Code Issues Packages Projects Releases Wiki Activity
518 Commits 8 Branches 0 Tags
Commit Graph

4 Commits

Author SHA1 Message Date
Sebastian Raschka
40ba3a4068 Remove leftover instances of self.tokenizer (#201) 
* Remove leftover instances of self.tokenizer

* add endoftext token
 2024-06-08 14:57:34 -05:00
Sebastian Raschka
3328b29521 cosmetics 2024-05-05 08:15:46 -05:00
rasbt
244593ce01 add text-to-token-id fn 2024-05-05 08:05:20 -05:00
Sebastian Raschka
004b0614fc Ch06 draft (#138) 
* Ch06 first draft

* add utility files
 2024-05-03 08:37:58 -05:00