yujunjun/LLMs-from-scratch
1
0
Fork 0
mirror of https://github.com/rasbt/LLMs-from-scratch.git synced 2025-08-28 10:30:36 +00:00
Code Issues Packages Projects Releases Wiki Activity

add instruction dataset

Browse Source
This commit is contained in:
rasbt 2024-06-08 10:38:41 -05:00
parent 517d86e58e
commit b80e7804b3
7 changed files with 5510 additions and 5 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2
README.md
View File

@ -56,7 +56,7 @@ Alternatively, you can view this and other files on GitHub at [https://github.co
| Ch 4: Implementing a GPT Model from Scratch | - [ch04.ipynb](ch04/01_main-chapter-code/ch04.ipynb)<br/>- [gpt.py](ch04/01_main-chapter-code/gpt.py) (summary)<br/>- [exercise-solutions.ipynb](ch04/01_main-chapter-code/exercise-solutions.ipynb) | [./ch04](./ch04) |
| Ch 5: Pretraining on Unlabeled Data | - [ch05.ipynb](ch05/01_main-chapter-code/ch05.ipynb)<br/>- [gpt_train.py](ch05/01_main-chapter-code/gpt_train.py) (summary) <br/>- [gpt_generate.py](ch05/01_main-chapter-code/gpt_generate.py) (summary) <br/>- [exercise-solutions.ipynb](ch05/01_main-chapter-code/exercise-solutions.ipynb) | [./ch05](./ch05) |
| Ch 6: Finetuning for Text Classification | - [ch06.ipynb](ch06/01_main-chapter-code/ch06.ipynb) <br/>- [gpt-class-finetune.py](ch06/01_main-chapter-code/gpt-class-finetune.py) <br/>- [exercise-solutions.ipynb](ch06/01_main-chapter-code/exercise-solutions.ipynb) | [./ch06](./ch06) |
| Ch 7: Instruction Finetuning | Q2 2024 | ... |
| Ch 7: Finetuning to Follow Instructions | Q2 2024 | ... |
| Appendix A: Introduction to PyTorch | - [code-part1.ipynb](appendix-A/01_main-chapter-code/code-part1.ipynb)<br/>- [code-part2.ipynb](appendix-A/01_main-chapter-code/code-part2.ipynb)<br/>- [DDP-script.py](appendix-A/01_main-chapter-code/DDP-script.py)<br/>- [exercise-solutions.ipynb](appendix-A/01_main-chapter-code/exercise-solutions.ipynb) | [./appendix-A](./appendix-A) |
| Appendix B: References and Further Reading | No code | - |
| Appendix C: Exercise Solutions | No code | - |

3
ch07/01_main-chapter-code/README.md Normal file
View File

@ -0,0 +1,3 @@
# Chapter 7: Finetuning to Follow Instructions
In progress ...

5502
ch07/01_main-chapter-code/instruction-data.json Normal file
View File

File diff suppressed because it is too large Load Diff

2
ch07/02_dataset-utilities/README.md
View File

@ -1,4 +1,4 @@
# Chapter 7: Instruction and Preference Finetuning
# Chapter 7: Finetuning to Follow Instructions
This folder contains utility code that can be used for preparing an instruction dataset.

2
ch07/03_model-evaluation/README.md
View File

@ -1,4 +1,4 @@
# Chapter 7: Instruction Finetuning
# Chapter 7: Finetuning to Follow Instructions
This folder contains utility code that can be used for model evaluation.

2
ch07/04_preference-tuning-with-dpo/README.md
View File

@ -1,3 +1,3 @@
# Chapter 7: Instruction Finetuning
# Chapter 7: Finetuning to Follow Instructions
In progress ...

2
ch07/README.md
View File

@ -1,3 +1,3 @@
# Chapter 7: Instruction Finetuning
# Chapter 7: Finetuning to Follow Instructions
In progress ...