909 Commits

Author SHA1 Message Date
Matthew Hernandez
1552023bd4
Fix issue 724: unused args (#726)
* Fix issue 724: unused args

* Update 02_opt_multi_gpu_ddp.py
2025-07-10 12:58:32 -05:00
Sebastian Raschka
5188a41267
Batched KV Cache Inference for Qwen3 (#735) 2025-07-10 12:52:29 -05:00
Sebastian Raschka
6515889431
Qwen3 tokenizer sanity checks (#730) 2025-07-10 12:52:29 -05:00
Sebastian Raschka
14fa50dfc8
Add more sophisticated Qwen3 tokenizer (#729) 2025-07-10 12:52:29 -05:00
Sebastian Raschka
f596aab0cb
Simplify KV cache usage (#728)
* Simplify KV cache usage

* Swap mark text with ghostwriter
2025-07-10 12:52:29 -05:00
Sebastian Raschka
4c2745509f
Update Qwen3 tokenizer test (#727)
* Update Qwen3 tokenizer test

* add tokenizers to dev dependencies

* add tokenizers to dev dependencies
2025-07-10 12:52:29 -05:00
rasbt
420081ae06
fix merge conflict 2025-07-10 12:52:10 -05:00
85853890+weezymatt@users.noreply.github.com
ede5cac208 Fix issue: 731 by resolving the semantic error 2025-07-09 21:24:27 -06:00
85853890+weezymatt@users.noreply.github.com
a96370df4a Fix issue: 731 by resolving the semantic error 2025-07-09 21:09:35 -06:00
Sebastian Raschka
c8c6e7814a
Update README.md 2025-07-06 17:58:33 -05:00
Sebastian Raschka
6103acbedb
Add prerequisite section (#723) 2025-07-06 12:45:42 -05:00
Sebastian Raschka
c62fc7cad1
Fix pip uv typo in installation instructions (#722) 2025-07-03 15:18:48 -05:00
Sebastian Raschka
0405b0c8e7
Handle other Qwen3 tokenizer settings (#716) 2025-06-30 17:49:51 -05:00
Sebastian Raschka
4e61dc4224
Fix d_out code comment in bonus materials (#715) 2025-06-28 10:07:16 -05:00
Sebastian Raschka
c4ec55edac
Support different Qwen3 sizes in pkg (#714) 2025-06-28 08:00:23 -05:00
Sebastian Raschka
ddbaf0d83e
Use test mode arg in ch07 (#713) 2025-06-27 19:28:56 -05:00
Sebastian Raschka
8b3e4b24b0
Remove unused params for hparam script (#710) 2025-06-25 12:50:32 -05:00
Sebastian Raschka
190c66b3b0
Add Qwen3 1.7, 4B, 8B, and 32B support to from-scratch nb (#709) 2025-06-25 08:53:09 -05:00
Sebastian Raschka
2f53bf5fe5
Link the other KV cache sections (#708) 2025-06-24 16:52:29 -05:00
Sebastian Raschka
47a750014d
Add link to free exercise PDF (#706) 2025-06-24 08:24:02 -05:00
Sebastian Raschka
3bdf18a599
Update Llama 3 table for consistency with Qwen3 2025-06-23 18:33:04 -05:00
Sebastian Raschka
81eda38d3b
Improve KV cache code for torch.compile (#705)
* Improve KV cache code for torch.compile

* cleanup

* cleanup
2025-06-23 18:08:49 -05:00
Martin Ma
6522be94be
Fix bug in masking when kv cache is used. (#697)
* Fix bug in masking when kv cache is used.

* add tests

* dd tests

* upd

* add kv cache test to gh workflow

* explicit mask slicing

* upd

---------

Co-authored-by: rasbt <mail@sebastianraschka.com>
2025-06-23 13:12:56 -05:00
Sebastian Raschka
37b26c2e04
CPU compile performance for Qwen3 models (#704)
* Ch06 classifier function asserts

* Qwen3 cpu compilation perf
2025-06-23 11:06:10 -05:00
Sebastian Raschka
4014bdd520
Ch06 classifier function asserts (#703) 2025-06-23 08:21:55 -05:00
Shamik
f5bc863752
Update README.md (#702)
Typo in kv cache readme
2025-06-23 07:21:51 -05:00
Matthew Hernandez
5c66f74fbe
Fix issue #684: Minor docstring edit (#699) 2025-06-23 07:18:28 -05:00
Sebastian Raschka
d37ddb668a
Fix code comment: embed_dim -> d_out (#698) 2025-06-22 16:36:39 -05:00
Sebastian Raschka
01be5a42e4
Use more recent sentencepiece tokenizer API (#696) 2025-06-22 13:52:30 -05:00
Sebastian Raschka
bcfdbd7008
Fix some wording issues in the notes (#695) 2025-06-22 13:46:16 -05:00
Sajjad Baloch
661a6e84ee
Fix: Typo in appendix_d.py comments. (#682)
* Fix: pkg/llms_from_scratch/appendix_d.py

* minor language typo fix

* fix 691

---------

Co-authored-by: PrinceSajjadHussain <PrinceSajjadHussain@users.noreply.github.com>
Co-authored-by: rasbt <mail@sebastianraschka.com>
2025-06-22 12:15:12 -05:00
casinca
564e986496
fix issue #664 - inverted token and pos emb layers (#665)
* fix inverted token and pos layers

* remove redundant code

---------

Co-authored-by: rasbt <mail@sebastianraschka.com>
2025-06-22 12:15:01 -05:00
Sebastian Raschka
0a2e8c39c4
Qwen3 KV cache (#688) 2025-06-21 17:34:39 -05:00
Daniel Kleine
14c054d36c
added pkg fixes (#676)
Co-authored-by: Sebastian Raschka <mail@sebastianraschka.com>
2025-06-21 16:07:50 -05:00
Sebastian Raschka
fdc3e1b701
Add GPT-2 KV cache to pkg (#687) 2025-06-21 12:29:04 -05:00
Sebastian Raschka
3be0f3202a
Llama 3 KV Cache (#685)
* Llama 3 KV Cache

* skip expensive tests on Gh actions

* Update __init__.py
2025-06-21 10:55:20 -05:00
Sebastian Raschka
c008f95072
Fix formatting in Qwen3 nb (#680)
* Fix formatting in Qwen3 nb

* upd
2025-06-20 07:28:27 -05:00
casinca
00b8c0a107
minor readability improvements (#668) 2025-06-19 18:56:49 -05:00
Daniel Kleine
15fa6a84f6
fixed plot_losses (#677) 2025-06-19 18:55:43 -05:00
Sebastian Raschka
e719bd86ad
Qwen3 From Scratch (#678)
* Qwen3 From Scratch

* rev other file

* upd

* upd

* upd

* url fixes
2025-06-19 18:44:38 -05:00
casinca
58b8672452
removed old args in GQA class (#674) 2025-06-17 13:09:53 -05:00
Sebastian Raschka
ece59ba587
Optimize KV cache (#673)
* Optimize KV cache

* style

* interpretable generate

* interpretable generate

* update readme
2025-06-16 16:00:50 -05:00
Sebastian Raschka
ba0370abd1
Optimized KV cache (#672)
* Optimized KV cache

* typo fix
2025-06-15 14:26:16 -05:00
Sebastian Raschka
2af686d70b
Add KV cache (#671) 2025-06-15 09:58:08 -05:00
Sebastian Raschka
78bbcb3643
Remove redundant model = (#663) 2025-06-13 11:03:55 -05:00
Sebastian Raschka
3dfd7e5f06
Update pixi (#661)
* Llama3 from scratch improvements

* Update HF hub version in pixi.toml

* Update README.md
2025-06-13 10:50:17 -05:00
Daniel Kleine
c2cfb47b1a
fixed gqa qkv code comments (#660) 2025-06-13 08:21:28 -05:00
Greg Gandenberger
7632eb018b
Update ch07.ipynb (#643)
Correct function name
2025-06-13 08:17:10 -05:00
Shimpei Kojio
baaa6c9283
fixed video link (#646) 2025-06-13 08:16:18 -05:00
Pratyush Subhadarshi
d56417c34c
Correcting the wrong reference (#649)
Co-authored-by: Sebastian Raschka <mail@sebastianraschka.com>
2025-06-12 16:35:51 -05:00