mirror of
https://github.com/rasbt/LLMs-from-scratch.git
synced 2025-10-29 08:50:34 +00:00
a08d7aaa84
* Uv workflow improvements * Uv workflow improvements * linter improvements * pytproject.toml fixes * pytproject.toml fixes * pytproject.toml fixes * pytproject.toml fixes * pytproject.toml fixes * pytproject.toml fixes * windows fixes * windows fixes * windows fixes * windows fixes * windows fixes * windows fixes * win32 fix * win32 fix * win32 fix * win32 fix * win32 fix * win32 fix * win32 fix * win32 fix * win32 fix * win32 fix * win32 fix * win32 fix * win32 fix * win32 fix * win32 fix * win32 fix * win32 fix * win32 fix * win32 fix
Alternative Approaches to Loading Pretrained Weights
This folder contains alternative weight loading strategies in case the weights become unavailable from OpenAI.
-
weight-loading-hf-transformers.ipynb: contains code to load the weights from the Hugging Face Model Hub via the
transformerslibrary -
weight-loading-hf-safetensors.ipynb: contains code to load the weights from the Hugging Face Model Hub via the
safetensorslibrary directly (skipping the instantiation of a Hugging Face transformer model)