yujunjun/LLMs-from-scratch

mirror of https://github.com/rasbt/LLMs-from-scratch.git synced 2025-08-09 01:02:50 +00:00

History

Sebastian Raschka c21bfe4a23

Add PyPI package (#576 )

* Add PyPI package

* fixes

* fixes

2025-03-23 19:28:49 -05:00

..

Auto download DPO dataset if not already available in path (#479 )

2025-01-12 12:27:28 -06:00

config.json

move access token to config.json

2024-09-23 08:56:16 -05:00

converting-gpt-to-llama2.ipynb

Add PyPI package (#576 )

2025-03-23 19:28:49 -05:00

converting-llama2-to-llama3.ipynb

Add PyPI package (#576 )

2025-03-23 19:28:49 -05:00

previous_chapters.py

GPT to Llama (#368 )

2024-09-23 07:34:06 -05:00

README.md

Implement Llama 3.2 (#383 )

2024-10-05 07:30:47 -05:00

requirements-extra.txt

fixed Llama 2 to 3.2 NBs (#388 )

2024-10-06 09:56:55 -05:00

standalone-llama32.ipynb

Uv workflow improvements (#531 )

2025-02-16 13:16:51 -06:00

README.md

Converting GPT to Llama

This folder contains code for converting the GPT implementation from chapter 4 and 5 to Meta AI's Llama architecture in the following recommended reading order:

converting-gpt-to-llama2.ipynb: contains code to convert GPT to Llama 2 7B step by step and loads pretrained weights from Meta AI
converting-llama2-to-llama3.ipynb: contains code to convert the Llama 2 model to Llama 3, Llama 3.1, and Llama 3.2
standalone-llama32.ipynb: a standalone notebook implementing Llama 3.2