LLMs-from-scratch/ch05/02_alternative_weight_loading/README.md

# Alternative Approaches to Loading Pretrained Weights

This folder contains alternative weight loading strategies in case the weights become unavailable from OpenAI.

- [weight-loading-pytorch.ipynb](weight-loading-pytorch.ipynb): (Recommended) contains code to load the weights from PyTorch state dicts that I created by converting the original TensorFlow weights

- [weight-loading-hf-transformers.ipynb](weight-loading-hf-transformers.ipynb): contains code to load the weights from the Hugging Face Model Hub via the `transformers` library

- [weight-loading-hf-safetensors.ipynb](weight-loading-hf-safetensors.ipynb): contains code to load the weights from the Hugging Face Model Hub via the `safetensors` library directly (skipping the instantiation of a Hugging Face transformer model)
Make header more clear 2024-05-25 10:44:12 -05:00			`# Alternative Approaches to Loading Pretrained Weights`
Add alternative weight loading strategy as backup (#82) 2024-03-20 08:43:18 -05:00
fixed empty space 2024-05-17 10:44:18 +02:00			`This folder contains alternative weight loading strategies in case the weights become unavailable from OpenAI.`
Add alternative weight loading strategy as backup (#82) 2024-03-20 08:43:18 -05:00
Alt weight loading code via PyTorch (#585) * Alt weight loading code via PyTorch * commit additional files 2025-03-27 20:10:23 -05:00			`- [weight-loading-pytorch.ipynb](weight-loading-pytorch.ipynb): (Recommended) contains code to load the weights from PyTorch state dicts that I created by converting the original TensorFlow weights`

fixed empty space 2024-05-17 10:44:18 +02:00			- [weight-loading-hf-transformers.ipynb](weight-loading-hf-transformers.ipynb): contains code to load the weights from the Hugging Face Model Hub via the `transformers` library
Alternative weight loading via .safetensors (#507) 2025-01-29 08:15:29 -06:00
			- [weight-loading-hf-safetensors.ipynb](weight-loading-hf-safetensors.ipynb): contains code to load the weights from the Hugging Face Model Hub via the `safetensors` library directly (skipping the instantiation of a Hugging Face transformer model)