yujunjun/LLMs-from-scratch
1
0
Fork 0
mirror of https://github.com/rasbt/LLMs-from-scratch.git synced 2025-08-30 03:20:51 +00:00
Code Issues Packages Projects Releases Wiki Activity
LLMs-from-scratch/ch02
History
Tao Qian 65ee619d3b Minor readability improvement in dataloader.ipynb (#461) 
* Minor readability improvement in dataloader.ipynb

- The tokenizer and encoded_text variables at the root level are unused.
- The default params for create_dataloader_v1 are confusing, especially for the default batch_size 4, which happens to be the same as the max_length.

* readability improvements

---------

Co-authored-by: rasbt <mail@sebastianraschka.com>
2025-01-04 11:26:10 -06:00
..
01_main-chapter-code
Minor readability improvement in dataloader.ipynb (#461)
2025-01-04 11:26:10 -06:00
02_bonus_bytepair-encoder
update formatting
2024-05-24 07:20:37 -05:00
03_bonus_embedding-vs-matmul
minor spelling fix
2024-09-08 15:35:36 -05:00
04_bonus_dataloader-intuition
fixed num_workers (#229)
2024-06-19 17:36:46 -05:00
README.md
Update bonus section formatting (#400)
2024-10-12 10:26:08 -05:00

README.md

Chapter 2: Working with Text Data

 

Main Chapter Code

 

Bonus Materials

  • 02_bonus_bytepair-encoder contains optional code to benchmark different byte pair encoder implementations

  • 03_bonus_embedding-vs-matmul contains optional (bonus) code to explain that embedding layers and fully connected layers applied to one-hot encoded vectors are equivalent.

  • 04_bonus_dataloader-intuition contains optional (bonus) code to explain the data loader more intuitively with simple numbers rather than text.