94 Commits

Author SHA1 Message Date
Sebastian Raschka
2351a1f282 Fix some wording issues in the notes (#695) 2025-06-22 13:46:16 -05:00
Henry Shi
88250d953d updated exercise 5.3 (#615)
* updated exercise 5.3

temperature can be set to 0 to regardless of top_k setting to force deterministic behavior

* fix notebook json

---------

Co-authored-by: Sebastian Raschka <mail@sebastianraschka.com>
2025-04-13 13:06:57 -05:00
Sebastian Raschka
e55e3e88e1 Alt weight loading code via PyTorch (#585)
* Alt weight loading code via PyTorch

* commit additional files
2025-03-27 20:10:23 -05:00
Sebastian Raschka
7114ccd10d Add PyPI package (#576)
* Add PyPI package

* fixes

* fixes
2025-03-23 19:28:49 -05:00
Greg Gandenberger
1ec5631c70 Fix minor printing issue and note inconsistency across platforms (#563)
* Fix printing issue and note inconsistency

* Rerun notebook
2025-03-14 15:12:09 -05:00
Sebastian Raschka
4fb0ea9d1f Specify UTF-8 encoding in the json load command explicitely (#557) 2025-03-05 11:46:21 -06:00
Sebastian Raschka
de60da9a6b Add a note about "zsh: illegal hardware instruction python" error (#555) 2025-03-02 15:18:24 -06:00
Sebastian Raschka
9dce43ec31 Upgrade to NumPy 2.0 (#520)
* Upgrade to NumPy 2.0

* bump pytorch

* bump pytorch

* bump pytorch

* bump pytorch

* bump pytorch

* update

* update packages
2025-02-09 06:21:58 -06:00
Sebastian Raschka
5efa731c0f Mention small discrepancy due to Dropout non-reproducibility in PyTorch (#519)
* Mention small discrepancy due to Dropout non-reproducibility in PyTorch

* bump pytorch version
2025-02-06 14:59:52 -06:00
Sebastian Raschka
fd24a3679a Alternative weight loading via .safetensors (#507) 2025-01-29 08:15:29 -06:00
Sebastian Raschka
7659af7cdd Add backup URL for gpt2 weights (#469)
* Add backup URL for gpt2 weights

* newline
2025-01-05 11:28:09 -06:00
Sebastian Raschka
05a816e270 fix misplaced parenthesis and update license (#466) 2025-01-04 11:14:08 -06:00
Sebastian Raschka
129d0d740f Add missing device transfer in gpt_generate.py (#436) 2024-11-14 19:12:53 +09:00
rasbt
58d0ce83a4 llama note 2024-09-26 07:41:11 -05:00
Sebastian Raschka
1bc560fb13 Add chatpgpt-like user interface (#360)
* Add chatpgpt-like user interface

* fixes
2024-09-17 08:26:44 -05:00
Sebastian Raschka
092b5b5429 topk comment 2024-08-20 20:44:15 -05:00
rasbt
f4e45a3f40 add note about duplicated cell 2024-08-19 21:04:18 -05:00
Sebastian Raschka
11e2f56af5 Note about MPS devices (#329) 2024-08-19 20:58:45 -05:00
Sebastian Raschka
0991c1ff24 Note about ch05 mps support (#324) 2024-08-19 07:40:24 -05:00
rasbt
742525cb28 remove redundant indentation 2024-08-16 07:54:02 -05:00
rasbt
6533ce63c1 fix code cell ordering 2024-08-12 19:04:05 -05:00
SSebo
22681878a8 Update ch05.ipynb (#297)
typo
2024-08-05 07:12:27 -05:00
Sebastian Raschka
6dd8666d9c Test code in pytorch 2.4 (#285)
* test code in pytorch 2.4

* update
2024-07-24 21:53:41 -05:00
TITC
bce3a708f9 47,678-->48,725 (#281) 2024-07-22 21:24:57 -05:00
Sebastian Raschka
d0f3b034d8 Add download help message (#274) 2024-07-19 08:29:29 -05:00
rasbt
5e24a042c1 add links to summary sections 2024-06-29 07:33:26 -05:00
rasbt
0f43890a15 refresh cross entropy figure 2024-06-29 07:22:23 -05:00
Daniel Kleine
fb4e37ae15 fixed minor issues (#252)
* fixed typo

* fixed var name in md text
2024-06-29 06:38:25 -05:00
Daniel Kleine
7a54d383e7 minor fixes (#246)
* removed duplicated white spaces

* Update ch07/01_main-chapter-code/ch07.ipynb

* Update ch07/05_dataset-generation/llama3-ollama.ipynb

* removed duplicated white spaces

* fixed title again

---------

Co-authored-by: Sebastian Raschka <mail@sebastianraschka.com>
2024-06-25 17:30:30 -05:00
Sebastian Raschka
def84a039c Show epochs as integers on x-axis (#241)
* Show epochs as integers on x-axis

* Update ch07/01_main-chapter-code/previous_chapters.py

* remove extra s

* modify exercise plots

* update chapter 7 plot

* resave ch07 for better file diff
2024-06-23 07:41:25 -05:00
rasbt
0026e6206b update generate to match output in main chapter 2024-06-22 12:01:51 -05:00
Daniel Kleine
7e0c5c0975 minor fixes (#235)
* removed unnecessary imports

* removed unnecessary semicolons

* format markdown

* format markdown

* fixed markdown
2024-06-21 08:40:54 -05:00
rasbt
e1046746e8 remove redundant line 2024-06-20 10:12:28 -05:00
rasbt
cb194fa8fa fix device loading 2024-06-20 08:07:00 -05:00
rasbt
c1f9361428 add main and optional sections 2024-06-19 17:48:25 -05:00
Daniel Kleine
73be1c592f fixed num_workers (#229)
* fixed num_workers

* ch06 & ch07: added num_workers to create_dataloader_v1
2024-06-19 17:36:46 -05:00
Sebastian Raschka
fcf8bcab0d Remove duplicated cell (#212)
* add a suggestion since code snippet has been repeated.

* remove duplicated cell

---------

Co-authored-by: Shuyib <benmainye@gmail.com>
2024-06-15 12:48:34 -05:00
rasbt
a796b9d657 explain truncation in ch05 2024-06-12 19:50:11 -05:00
Sebastian Raschka
8d3e58ff81 check gpt files (#208) 2024-06-12 07:19:10 -05:00
rasbt
f0e4c99bc3 fix typo in comment 2024-06-09 06:14:02 -05:00
Sebastian Raschka
40ba3a4068 Remove leftover instances of self.tokenizer (#201)
* Remove leftover instances of self.tokenizer

* add endoftext token
2024-06-08 14:57:34 -05:00
rasbt
f7e528fca6 update loss 2024-05-31 07:30:57 -05:00
Kumar Utsav
b48d436bfc Update ch05.ipynb
Fixed incorrect token ids
2024-05-29 20:34:23 +05:30
rasbt
fe8bb9291e update formatting 2024-05-24 07:20:37 -05:00
Daniel Kleine
69da9ed447 removed unnecessary .gitignore 2024-05-21 19:25:16 +00:00
rasbt
bc5cbbf1bd change defaults to 0 temp 2024-05-19 09:04:49 -05:00
rasbt
59f5ed8d68 use default value for temperature 2024-05-19 08:48:10 -05:00
rasbt
9d84935b69 add eos_id option for ch07 2024-05-18 12:35:40 -05:00
rasbt
b350daaa93 add readme 2024-05-13 08:50:55 -05:00
speed
7b34833ee1 fix 1024 characters to 1024 tokens (#152) 2024-05-11 13:17:07 -05:00