66 Commits

Author SHA1 Message Date
Sebastian Raschka
bcfdbd7008
Fix some wording issues in the notes (#695) 2025-06-22 13:46:16 -05:00
Sebastian Raschka
3f93d73d6d
Alt weight loading code via PyTorch (#585)
* Alt weight loading code via PyTorch

* commit additional files
2025-03-27 20:10:23 -05:00
Sebastian Raschka
c21bfe4a23
Add PyPI package (#576)
* Add PyPI package

* fixes

* fixes
2025-03-23 19:28:49 -05:00
Greg Gandenberger
c1611d4ea8
Fix minor printing issue and note inconsistency across platforms (#563)
* Fix printing issue and note inconsistency

* Rerun notebook
2025-03-14 15:12:09 -05:00
Sebastian Raschka
5fc78ff9fd
Add a note about "zsh: illegal hardware instruction python" error (#555) 2025-03-02 15:18:24 -06:00
Sebastian Raschka
a6cc574605
Upgrade to NumPy 2.0 (#520)
* Upgrade to NumPy 2.0

* bump pytorch

* bump pytorch

* bump pytorch

* bump pytorch

* bump pytorch

* update

* update packages
2025-02-09 06:21:58 -06:00
Sebastian Raschka
68e2efe1c9
Mention small discrepancy due to Dropout non-reproducibility in PyTorch (#519)
* Mention small discrepancy due to Dropout non-reproducibility in PyTorch

* bump pytorch version
2025-02-06 14:59:52 -06:00
Sebastian Raschka
25ea71e713
Alternative weight loading via .safetensors (#507) 2025-01-29 08:15:29 -06:00
rasbt
bfa4215774
llama note 2024-09-26 07:41:11 -05:00
Sebastian Raschka
ea9b4e83a4
Add chatpgpt-like user interface (#360)
* Add chatpgpt-like user interface

* fixes
2024-09-17 08:26:44 -05:00
Sebastian Raschka
c2117ca073 topk comment 2024-08-20 20:44:15 -05:00
Sebastian Raschka
01cb137bfd
Note about MPS devices (#329) 2024-08-19 20:58:45 -05:00
Sebastian Raschka
8ef5022511
Note about ch05 mps support (#324) 2024-08-19 07:40:24 -05:00
rasbt
b2858a91c5
remove redundant indentation 2024-08-16 07:54:02 -05:00
rasbt
5f0c55ddee
fix code cell ordering 2024-08-12 19:04:05 -05:00
SSebo
7643c6c0c4
Update ch05.ipynb (#297)
typo
2024-08-05 07:12:27 -05:00
Sebastian Raschka
08040f024c
Test code in pytorch 2.4 (#285)
* test code in pytorch 2.4

* update
2024-07-24 21:53:41 -05:00
TITC
6cbe6520a2
47,678-->48,725 (#281) 2024-07-22 21:24:57 -05:00
rasbt
31806828d0
add links to summary sections 2024-06-29 07:33:26 -05:00
rasbt
219f45f808
refresh cross entropy figure 2024-06-29 07:22:23 -05:00
Daniel Kleine
1e69c8e0b5
fixed minor issues (#252)
* fixed typo

* fixed var name in md text
2024-06-29 06:38:25 -05:00
Daniel Kleine
81c843bdc0
minor fixes (#246)
* removed duplicated white spaces

* Update ch07/01_main-chapter-code/ch07.ipynb

* Update ch07/05_dataset-generation/llama3-ollama.ipynb

* removed duplicated white spaces

* fixed title again

---------

Co-authored-by: Sebastian Raschka <mail@sebastianraschka.com>
2024-06-25 17:30:30 -05:00
Sebastian Raschka
cf0df54d7d
Show epochs as integers on x-axis (#241)
* Show epochs as integers on x-axis

* Update ch07/01_main-chapter-code/previous_chapters.py

* remove extra s

* modify exercise plots

* update chapter 7 plot

* resave ch07 for better file diff
2024-06-23 07:41:25 -05:00
rasbt
977f9c6eac
fix device loading 2024-06-20 08:07:00 -05:00
Sebastian Raschka
7bf70baf10
Remove duplicated cell (#212)
* add a suggestion since code snippet has been repeated.

* remove duplicated cell

---------

Co-authored-by: Shuyib <benmainye@gmail.com>
2024-06-15 12:48:34 -05:00
rasbt
c6466990bb
explain truncation in ch05 2024-06-12 19:50:11 -05:00
rasbt
1b1fd21d64
fix typo in comment 2024-06-09 06:14:02 -05:00
rasbt
b352d9ef0a
update loss 2024-05-31 07:30:57 -05:00
Kumar Utsav
bc5d73857c
Update ch05.ipynb
Fixed incorrect token ids
2024-05-29 20:34:23 +05:30
rasbt
98d453b666
update formatting 2024-05-24 07:20:37 -05:00
rasbt
a5593f9860
change defaults to 0 temp 2024-05-19 09:04:49 -05:00
rasbt
1463b2ae47
use default value for temperature 2024-05-19 08:48:10 -05:00
rasbt
4851d5a0fa
add eos_id option for ch07 2024-05-18 12:35:40 -05:00
speed
45f6e72f40
fix 1024 characters to 1024 tokens (#152) 2024-05-11 13:17:07 -05:00
rasbt
aec169dc12 link formatting 2024-04-30 06:26:23 -05:00
Sebastian Raschka
c70ddff558
Return nan if val loader is empty (#124) 2024-04-20 08:02:30 -05:00
Sebastian Raschka
155ac03f61
use torch no grad for loss (#119) 2024-04-14 08:13:07 -05:00
Sebastian Raschka
dd51d4ad83
Make datesets and loaders compatible with multiprocessing (#118) 2024-04-13 13:57:56 -05:00
Sebastian Raschka
9f3f231ac7 use correct lr 2024-04-12 19:55:07 -04:00
Sebastian Raschka
55ebabf95c
Automated link checking (#117)
* Automated link checking

* Fix links in Jupyter Nbs
2024-04-12 19:08:34 -04:00
Sebastian Raschka
e757091301
Organized setup instructions (#115)
* Organized setup instructions

* update tets

* link checker action

* raise error upon broken link

* fix links

* fix links

* delete duplicated paragraph
2024-04-10 22:09:46 -04:00
rasbt
58d5bd9e39 address suggestions to improve clarity 2024-04-07 08:41:09 -05:00
rasbt
c5a17393fc variable renaming for clarity 2024-04-05 07:26:42 -05:00
rasbt
8c36399e7c rename hparams to settings 2024-04-05 07:24:46 -05:00
Sebastian Raschka
adc2964fc5
Fix Loss in Gutenberg bonus section (#109) 2024-04-04 20:54:09 -05:00
Sebastian Raschka
2de60d1bfb
Rename variable to context_length to make it easier on readers (#106)
* rename to context length

* fix spacing
2024-04-04 07:27:41 -05:00
Sebastian Raschka
3829ccdb34
Remove reundant dropout in MLP module (#105) 2024-04-03 20:19:08 -05:00
rasbt
e14585e954 rename batch to text 2024-04-02 20:46:53 -05:00
rasbt
776a517d18 figure scaling 2024-04-01 08:05:01 -05:00
rasbt
ee096986ea upload exercise solutions of ch05 2024-03-31 20:28:51 -05:00