mirror of
https://github.com/rasbt/LLMs-from-scratch.git
synced 2025-07-23 17:03:47 +00:00
cec445f146
* Minor readability improvement in dataloader.ipynb - The tokenizer and encoded_text variables at the root level are unused. - The default params for create_dataloader_v1 are confusing, especially for the default batch_size 4, which happens to be the same as the max_length. * readability improvements --------- Co-authored-by: rasbt <mail@sebastianraschka.com>
Chapter 2: Working with Text Data
Main Chapter Code
- ch02.ipynb contains all the code as it appears in the chapter
Optional Code
- dataloader.ipynb is a minimal notebook with the main data loading pipeline implemented in this chapter