yujunjun/LLMs-from-scratch
1
0
Fork 0
mirror of https://github.com/rasbt/LLMs-from-scratch.git synced 2025-08-28 18:40:01 +00:00
Code Issues Packages Projects Releases Wiki Activity
810 Commits 8 Branches 0 Tags
Commit Graph

61 Commits

Author SHA1 Message Date
Sebastian Raschka
9dce43ec31 Upgrade to NumPy 2.0 (#520) 
* Upgrade to NumPy 2.0

* bump pytorch

* bump pytorch

* bump pytorch

* bump pytorch

* bump pytorch

* update

* update packages
 2025-02-09 06:21:58 -06:00
Sebastian Raschka
5efa731c0f Mention small discrepancy due to Dropout non-reproducibility in PyTorch (#519) 
* Mention small discrepancy due to Dropout non-reproducibility in PyTorch

* bump pytorch version
 2025-02-06 14:59:52 -06:00
Sebastian Raschka
fd24a3679a Alternative weight loading via .safetensors (#507) 2025-01-29 08:15:29 -06:00
rasbt
58d0ce83a4 llama note 2024-09-26 07:41:11 -05:00
Sebastian Raschka
1bc560fb13 Add chatpgpt-like user interface (#360) 
* Add chatpgpt-like user interface

* fixes
 2024-09-17 08:26:44 -05:00
Sebastian Raschka
092b5b5429 topk comment 2024-08-20 20:44:15 -05:00
Sebastian Raschka
11e2f56af5 Note about MPS devices (#329) 2024-08-19 20:58:45 -05:00
Sebastian Raschka
0991c1ff24 Note about ch05 mps support (#324) 2024-08-19 07:40:24 -05:00
rasbt
742525cb28 remove redundant indentation 2024-08-16 07:54:02 -05:00
rasbt
6533ce63c1 fix code cell ordering 2024-08-12 19:04:05 -05:00
SSebo
22681878a8 Update ch05.ipynb (#297) 
typo
 2024-08-05 07:12:27 -05:00
Sebastian Raschka
6dd8666d9c Test code in pytorch 2.4 (#285) 
* test code in pytorch 2.4

* update
 2024-07-24 21:53:41 -05:00
TITC
bce3a708f9 47,678-->48,725 (#281) 2024-07-22 21:24:57 -05:00
rasbt
5e24a042c1 add links to summary sections 2024-06-29 07:33:26 -05:00
rasbt
0f43890a15 refresh cross entropy figure 2024-06-29 07:22:23 -05:00
Daniel Kleine
fb4e37ae15 fixed minor issues (#252) 
* fixed typo

* fixed var name in md text
 2024-06-29 06:38:25 -05:00
Daniel Kleine
7a54d383e7 minor fixes (#246) 
* removed duplicated white spaces

* Update ch07/01_main-chapter-code/ch07.ipynb

* Update ch07/05_dataset-generation/llama3-ollama.ipynb

* removed duplicated white spaces

* fixed title again

---------

Co-authored-by: Sebastian Raschka <mail@sebastianraschka.com>
 2024-06-25 17:30:30 -05:00
Sebastian Raschka
def84a039c Show epochs as integers on x-axis (#241) 
* Show epochs as integers on x-axis

* Update ch07/01_main-chapter-code/previous_chapters.py

* remove extra s

* modify exercise plots

* update chapter 7 plot

* resave ch07 for better file diff
 2024-06-23 07:41:25 -05:00
rasbt
cb194fa8fa fix device loading 2024-06-20 08:07:00 -05:00
Sebastian Raschka
fcf8bcab0d Remove duplicated cell (#212) 
* add a suggestion since code snippet has been repeated.

* remove duplicated cell

---------

Co-authored-by: Shuyib <benmainye@gmail.com>
 2024-06-15 12:48:34 -05:00
rasbt
a796b9d657 explain truncation in ch05 2024-06-12 19:50:11 -05:00
rasbt
f0e4c99bc3 fix typo in comment 2024-06-09 06:14:02 -05:00
rasbt
f7e528fca6 update loss 2024-05-31 07:30:57 -05:00
Kumar Utsav
b48d436bfc Update ch05.ipynb 
Fixed incorrect token ids
 2024-05-29 20:34:23 +05:30
rasbt
fe8bb9291e update formatting 2024-05-24 07:20:37 -05:00
rasbt
bc5cbbf1bd change defaults to 0 temp 2024-05-19 09:04:49 -05:00
rasbt
59f5ed8d68 use default value for temperature 2024-05-19 08:48:10 -05:00
rasbt
9d84935b69 add eos_id option for ch07 2024-05-18 12:35:40 -05:00
speed
7b34833ee1 fix 1024 characters to 1024 tokens (#152) 2024-05-11 13:17:07 -05:00
rasbt
bb59cbc525 link formatting 2024-04-30 06:26:23 -05:00
Sebastian Raschka
4557d5830e Return nan if val loader is empty (#124) 2024-04-20 08:02:30 -05:00
Sebastian Raschka
ef2de4718e use torch no grad for loss (#119) 2024-04-14 08:13:07 -05:00
Sebastian Raschka
bae4b0fb08 Make datesets and loaders compatible with multiprocessing (#118) 2024-04-13 13:57:56 -05:00
Sebastian Raschka
8fe63a9a0e use correct lr 2024-04-12 19:55:07 -04:00
Sebastian Raschka
bbce1cb143 Automated link checking (#117) 
* Automated link checking

* Fix links in Jupyter Nbs
 2024-04-12 19:08:34 -04:00
Sebastian Raschka
790d0808b2 Organized setup instructions (#115) 
* Organized setup instructions

* update tets

* link checker action

* raise error upon broken link

* fix links

* fix links

* delete duplicated paragraph
 2024-04-10 22:09:46 -04:00
rasbt
8462a777bd address suggestions to improve clarity 2024-04-07 08:41:09 -05:00
rasbt
84b785ddd0 variable renaming for clarity 2024-04-05 07:26:42 -05:00
rasbt
c31e99720d rename hparams to settings 2024-04-05 07:24:46 -05:00
Sebastian Raschka
25f533efe0 Fix Loss in Gutenberg bonus section (#109) 2024-04-04 20:54:09 -05:00
Sebastian Raschka
ccd7cebbb3 Rename variable to context_length to make it easier on readers (#106) 
* rename to context length

* fix spacing
 2024-04-04 07:27:41 -05:00
Sebastian Raschka
5beff4e25a Remove reundant dropout in MLP module (#105) 2024-04-03 20:19:08 -05:00
rasbt
cd12b4a937 rename batch to text 2024-04-02 20:46:53 -05:00
rasbt
776a517d18 figure scaling 2024-04-01 08:05:01 -05:00
rasbt
ee096986ea upload exercise solutions of ch05 2024-03-31 20:28:51 -05:00
rasbt
83adc4a2ac add weight sizes 2024-03-31 08:48:19 -05:00
rasbt
1c173e4f44 update figures 2024-03-30 09:43:51 -05:00
rasbt
ab1e56a323 reorg files and make standalone download file 2024-03-29 08:16:22 -05:00
rasbt
3c5b288ca0 minor typo fixes 2024-03-28 08:02:05 -05:00
rasbt
88b2dd780a make batch loss calculatution more efficient 2024-03-27 07:11:56 -05:00