yujunjun/LLMs-from-scratch
1
0
Fork 0
mirror of https://github.com/rasbt/LLMs-from-scratch.git synced 2025-08-28 18:40:01 +00:00
Code Issues Packages Projects Releases Wiki Activity

add instruction dataset

Browse Source
This commit is contained in:
rasbt 2024-06-08 10:38:41 -05:00
parent 517d86e58e
commit b80e7804b3
7 changed files with 5510 additions and 5 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2
README.md
View File

@ -56,7 +56,7 @@ Alternatively, you can view this and other files on GitHub at [https://github.co
| Ch 4: Implementing a GPT Model from Scratch | - [ch04.ipynb](ch04/01_main-chapter-code/ch04.ipynb)<br/>- [gpt.py](ch04/01_main-chapter-code/gpt.py) (summary)<br/>- [exercise-solutions.ipynb](ch04/01_main-chapter-code/exercise-solutions.ipynb) | [./ch04](./ch04) | | Ch 4: Implementing a GPT Model from Scratch | - [ch04.ipynb](ch04/01_main-chapter-code/ch04.ipynb)<br/>- [gpt.py](ch04/01_main-chapter-code/gpt.py) (summary)<br/>- [exercise-solutions.ipynb](ch04/01_main-chapter-code/exercise-solutions.ipynb) | [./ch04](./ch04) |
| Ch 5: Pretraining on Unlabeled Data | - [ch05.ipynb](ch05/01_main-chapter-code/ch05.ipynb)<br/>- [gpt_train.py](ch05/01_main-chapter-code/gpt_train.py) (summary) <br/>- [gpt_generate.py](ch05/01_main-chapter-code/gpt_generate.py) (summary) <br/>- [exercise-solutions.ipynb](ch05/01_main-chapter-code/exercise-solutions.ipynb) | [./ch05](./ch05) | | Ch 5: Pretraining on Unlabeled Data | - [ch05.ipynb](ch05/01_main-chapter-code/ch05.ipynb)<br/>- [gpt_train.py](ch05/01_main-chapter-code/gpt_train.py) (summary) <br/>- [gpt_generate.py](ch05/01_main-chapter-code/gpt_generate.py) (summary) <br/>- [exercise-solutions.ipynb](ch05/01_main-chapter-code/exercise-solutions.ipynb) | [./ch05](./ch05) |
| Ch 6: Finetuning for Text Classification | - [ch06.ipynb](ch06/01_main-chapter-code/ch06.ipynb) <br/>- [gpt-class-finetune.py](ch06/01_main-chapter-code/gpt-class-finetune.py) <br/>- [exercise-solutions.ipynb](ch06/01_main-chapter-code/exercise-solutions.ipynb) | [./ch06](./ch06) | | Ch 6: Finetuning for Text Classification | - [ch06.ipynb](ch06/01_main-chapter-code/ch06.ipynb) <br/>- [gpt-class-finetune.py](ch06/01_main-chapter-code/gpt-class-finetune.py) <br/>- [exercise-solutions.ipynb](ch06/01_main-chapter-code/exercise-solutions.ipynb) | [./ch06](./ch06) |
| Ch 7: Instruction Finetuning | Q2 2024 | ... | | Ch 7: Finetuning to Follow Instructions | Q2 2024 | ... |
| Appendix A: Introduction to PyTorch | - [code-part1.ipynb](appendix-A/01_main-chapter-code/code-part1.ipynb)<br/>- [code-part2.ipynb](appendix-A/01_main-chapter-code/code-part2.ipynb)<br/>- [DDP-script.py](appendix-A/01_main-chapter-code/DDP-script.py)<br/>- [exercise-solutions.ipynb](appendix-A/01_main-chapter-code/exercise-solutions.ipynb) | [./appendix-A](./appendix-A) | | Appendix A: Introduction to PyTorch | - [code-part1.ipynb](appendix-A/01_main-chapter-code/code-part1.ipynb)<br/>- [code-part2.ipynb](appendix-A/01_main-chapter-code/code-part2.ipynb)<br/>- [DDP-script.py](appendix-A/01_main-chapter-code/DDP-script.py)<br/>- [exercise-solutions.ipynb](appendix-A/01_main-chapter-code/exercise-solutions.ipynb) | [./appendix-A](./appendix-A) |
| Appendix B: References and Further Reading | No code | - | | Appendix B: References and Further Reading | No code | - |
| Appendix C: Exercise Solutions | No code | - | | Appendix C: Exercise Solutions | No code | - |

3
ch07/01_main-chapter-code/README.md Normal file
View File

@ -0,0 +1,3 @@
# Chapter 7: Finetuning to Follow Instructions
In progress ...

5502
ch07/01_main-chapter-code/instruction-data.json Normal file
View File

File diff suppressed because it is too large Load Diff

2
ch07/02_dataset-utilities/README.md
View File

@ -1,4 +1,4 @@
# Chapter 7: Instruction and Preference Finetuning # Chapter 7: Finetuning to Follow Instructions
This folder contains utility code that can be used for preparing an instruction dataset. This folder contains utility code that can be used for preparing an instruction dataset.

2
ch07/03_model-evaluation/README.md
View File

@ -1,4 +1,4 @@
# Chapter 7: Instruction Finetuning # Chapter 7: Finetuning to Follow Instructions
This folder contains utility code that can be used for model evaluation. This folder contains utility code that can be used for model evaluation.

2
ch07/04_preference-tuning-with-dpo/README.md
View File

@ -1,3 +1,3 @@
# Chapter 7: Instruction Finetuning # Chapter 7: Finetuning to Follow Instructions
In progress ... In progress ...

2
ch07/README.md
View File

@ -1,3 +1,3 @@
# Chapter 7: Instruction Finetuning # Chapter 7: Finetuning to Follow Instructions
In progress ... In progress ...