LLMs-from-scratch/ch02/01_main-chapter-code
Sebastian Raschka 72a073bbbf
Remove leftover instances of self.tokenizer (#201)
* Remove leftover instances of self.tokenizer

* add endoftext token
2024-06-08 14:57:34 -05:00
..
2024-05-24 07:20:37 -05:00
2024-02-05 06:51:58 -06:00
2023-09-28 07:08:50 -05:00

Chapter 2: Working with Text Data

  • ch02.ipynb contains all the code as it appears in the chapter
  • dataloader.ipynb is a minimal notebook with the main data loading pipeline implemented in this chapter