LLMs-from-scratch/ch06

Chapter 6: Finetuning for Classification

 

Main Chapter Code

• 01_main-chapter-code contains the main chapter code

 

Bonus Materials

• 02_bonus_additional-experiments includes additional experiments (e.g., training the last vs first token, extending the input length, etc.)
• 03_bonus_imdb-classification compares the LLM from chapter 6 with other models on a 50k IMDb movie review sentiment classification dataset
• 04_user_interface implements an interactive user interface to interact with the pretrained LLM