yujunjun/LLMs-from-scratch
1
0
Fork 0
mirror of https://github.com/rasbt/LLMs-from-scratch.git synced 2025-10-31 01:41:26 +00:00
Code Issues Packages Projects Releases Wiki Activity
LLMs-from-scratch/ch07/05_dataset-generation
History

README.md

Generating Datasets for Instruction Finetuning

This folder contains utility code that can be used for generating a dataset for instruction finetuning.

  • llama3-ollama.ipynb: A notebook that creates a synthetic instruction finetuning dataset using Llama 3 and Ollama

  • reflection-gpt4.ipynb: A notebook that implements an instruction dataset refinement step based on reflection-tuning