LLMs-from-scratch/ch07/05_dataset-generation/README.md

# Generating Datasets for Instruction Finetuning

This folder contains utility code that can be used for generating a dataset for instruction finetuning.

- [llama3-ollama.ipynb](llama3-ollama.ipynb): A notebook that creates a synthetic instruction finetuning dataset using Llama 3 and Ollama

- [reflection-gpt4.ipynb](reflection-gpt4.ipynb): A notebook that implements an instruction dataset refinement step based on reflection-tuning
reflection-tuning dataset generation (#349) 2024-09-10 21:42:12 -05:00			`# Generating Datasets for Instruction Finetuning`
Generating a synthetic dataset for instruction finetuning (#245) * Generating a synthetic dataset for instruction finetuning * fix link 2024-06-23 21:48:25 -05:00
			`This folder contains utility code that can be used for generating a dataset for instruction finetuning.`

Generate preference dataset with Llama 3.1 70B (#289) 2024-07-27 09:44:04 -05:00			`- [llama3-ollama.ipynb](llama3-ollama.ipynb): A notebook that creates a synthetic instruction finetuning dataset using Llama 3 and Ollama`
Generating a synthetic dataset for instruction finetuning (#245) * Generating a synthetic dataset for instruction finetuning * fix link 2024-06-23 21:48:25 -05:00
reflection-tuning dataset generation (#349) 2024-09-10 21:42:12 -05:00			`- [reflection-gpt4.ipynb](reflection-gpt4.ipynb): A notebook that implements an instruction dataset refinement step based on reflection-tuning`