rasbt
|
1f4fca9f8e
|
update reference numbers
|
2024-10-11 12:13:10 -05:00 |
|
Sebastian Raschka
|
6d0f59a49c
|
Add MFU formula as reference material (#395)
* add MFU formula as reference material
* Update previous_chapters.py
|
2024-10-10 19:42:53 -05:00 |
|
Sebastian Raschka
|
1a8d2929dd
|
Update check-links.yml
|
2024-10-08 08:38:48 -05:00 |
|
Sebastian Raschka
|
ec18b6a8a3
|
Add Llama 3.2 RoPE to CI (#391)
* add Llama 3.2 RoPE to CI
* update
|
2024-10-08 08:28:34 -05:00 |
|
Sebastian Raschka
|
1eb0b3810a
|
Introduce buffers to improve Llama 3.2 efficiency (#389)
* Introduce buffers to improve Llama 3.2 efficiency
* update
* update
|
2024-10-06 12:49:04 -05:00 |
|
Daniel Kleine
|
a0c0c765a8
|
fixed Llama 2 to 3.2 NBs (#388)
* updated requirements
* fixes llama2 to llama3
* fixed llama 3.2 standalone
* fixed typo
* fixed rope formula
* Update requirements-extra.txt
* Update ch05/07_gpt_to_llama/converting-llama2-to-llama3.ipynb
* Update ch05/07_gpt_to_llama/converting-llama2-to-llama3.ipynb
* Update ch05/07_gpt_to_llama/standalone-llama32.ipynb
---------
Co-authored-by: Sebastian Raschka <mail@sebastianraschka.com>
|
2024-10-06 09:56:55 -05:00 |
|
Sebastian Raschka
|
0972ded530
|
Add a note about weight tying in Llama 3.2 (#386)
|
2024-10-05 09:20:54 -05:00 |
|
Sebastian Raschka
|
8a448a4410
|
Llama 3 (#384)
* Implement Llama 3.2
* Add Llama 3.2 files
* exclude IMDB link because stanford website seems down
|
2024-10-05 07:52:15 -05:00 |
|
Sebastian Raschka
|
8553644440
|
Llama 3.2 requirements file
|
2024-10-05 07:32:43 -05:00 |
|
Sebastian Raschka
|
b44096acef
|
Implement Llama 3.2 (#383)
|
2024-10-05 07:30:47 -05:00 |
|
Sebastian Raschka
|
a5405c255d
|
Cos-sin fix in Llama 2 bonus notebook (#381)
|
2024-10-03 20:45:40 -05:00 |
|
Sebastian Raschka
|
b993c2b25b
|
Improve rope settings for llama3 (#380)
|
2024-10-03 08:29:54 -05:00 |
|
rasbt
|
278a50a348
|
add section numbers
|
2024-09-30 08:42:22 -05:00 |
|
Sebastian Raschka
|
4caafddb93
|
Improve DDP on Windows (#376)
* Update DDP-script.py for Windows
* Windows handling
---------
Co-authored-by: Nathan Brown <nathan@nkbrown.us>
|
2024-09-29 16:53:48 -05:00 |
|
rasbt
|
bfa4215774
|
llama note
|
2024-09-26 07:41:11 -05:00 |
|
Sebastian Raschka
|
7ef5129e18
|
Fix truncation issue in classify_review function (#373)
|
2024-09-25 19:54:36 -05:00 |
|
Sebastian Raschka
|
b56d0b2942
|
Add llama2 unit tests (#372)
* add llama2 unit tests
* update
* updates
* updates
* update file path
* update requirements file
* rmsnorm test
* update
|
2024-09-25 19:40:36 -05:00 |
|
rasbt
|
a6d8e93da3
|
improve formatting
|
2024-09-24 18:49:17 -05:00 |
|
Daniel Kleine
|
ff31b345b0
|
ch05/07 gpt_to_llama text improvements (#369)
* fixed typo
* fixed RMSnorm formula
* fixed SwiGLU formula
* temperature=0 for untrained model for reproducibility
* added extra info hf token
|
2024-09-24 18:45:49 -05:00 |
|
rasbt
|
d144bd5b7a
|
add json import
|
2024-09-23 09:12:35 -05:00 |
|
rasbt
|
6bc3de165c
|
move access token to config.json
|
2024-09-23 08:56:16 -05:00 |
|
rasbt
|
58df945ed4
|
add llama3 comparison
|
2024-09-23 08:17:10 -05:00 |
|
Sebastian Raschka
|
0467c8289b
|
GPT to Llama (#368)
* GPT to Llama
* fix urls
|
2024-09-23 07:34:06 -05:00 |
|
rasbt
|
dc1b1a05b0
|
note about random numbers
|
2024-09-22 12:02:03 -05:00 |
|
Daniel Kleine
|
5f36d2af4c
|
removed unnecessary imports (#367)
|
2024-09-22 11:59:37 -05:00 |
|
Sebastian Raschka
|
76e9a9ec02
|
Add user interface to ch06 and ch07 (#366)
* Add user interface to ch06 and ch07
* pep8
* fix url
|
2024-09-21 20:33:00 -05:00 |
|
rasbt
|
6f6dfb6796
|
remove unused function from user interface
|
2024-09-21 14:17:35 -05:00 |
|
Sebastian Raschka
|
52ee1c7cdb
|
Add missing bullet point
|
2024-09-21 12:59:12 -05:00 |
|
Sebastian Raschka
|
222f7b16f8
|
update gpt-2 paper url
|
2024-09-20 07:00:06 -07:00 |
|
Daniel Kleine
|
eefe4bf12b
|
Chainlit bonus material fixes (#361)
* fix cmd
* moved idx to device
* improved code with clone().detach()
* fixed path
* fix: added extra line for pep8
* updated .gitginore
* Update ch05/06_user_interface/app_orig.py
* Update ch05/06_user_interface/app_own.py
* Apply suggestions from code review
---------
Co-authored-by: Sebastian Raschka <mail@sebastianraschka.com>
|
2024-09-18 08:08:50 -07:00 |
|
Sebastian Raschka
|
ea9b4e83a4
|
Add chatpgpt-like user interface (#360)
* Add chatpgpt-like user interface
* fixes
|
2024-09-17 08:26:44 -05:00 |
|
rasbt
|
b4f72812ed
|
update link checking
|
2024-09-15 08:16:23 -05:00 |
|
rasbt
|
6110858d5b
|
Clarify API usage limits in bonus content
|
2024-09-15 08:05:04 -05:00 |
|
Daniel Kleine
|
cc0c28dbf5
|
improved .vscode setup instructions (#353)
* improved .vscode project setup
* fixed spell check
* add missing 'p'
* Update README.md
---------
Co-authored-by: Sebastian Raschka <mail@sebastianraschka.com>
|
2024-09-15 07:43:43 -05:00 |
|
Jinge Wang
|
4210386cec
|
Fix 2 typos in 04_preferene-tuning-with-dpo (#356)
|
2024-09-15 07:36:22 -05:00 |
|
rasbt
|
962dc6f5de
|
update setup guide
|
2024-09-13 08:16:53 -05:00 |
|
Mingyuan Xu
|
f77c376b05
|
Run generate example in ch06 optionally on GPU (#352)
* model.to("cuda")
model.to("cuda")
* update device placement
---------
Co-authored-by: rasbt <mail@sebastianraschka.com>
|
2024-09-13 08:01:52 -05:00 |
|
rasbt
|
6f92909e58
|
Clarify extension instalation
|
2024-09-12 07:59:17 -05:00 |
|
Sebastian Raschka
|
11f97a13b6
|
Simplify conda section
|
2024-09-11 21:17:59 -05:00 |
|
rasbt
|
f1accdf273
|
clarifications
|
2024-09-11 20:16:35 -05:00 |
|
rasbt
|
fe2136e7c9
|
update title
|
2024-09-10 21:43:32 -05:00 |
|
Sebastian Raschka
|
835ed29dbf
|
reflection-tuning dataset generation (#349)
|
2024-09-10 21:42:12 -05:00 |
|
rasbt
|
8ad50a3315
|
update gpt-2 paper link
|
2024-09-09 06:31:28 -05:00 |
|
rasbt
|
1e48c13e89
|
update gpt-2 paper link
|
2024-09-08 15:49:44 -05:00 |
|
rasbt
|
b94546aa14
|
minor spelling fix
|
2024-09-08 15:35:36 -05:00 |
|
Daniel Kleine
|
2ee3df622e
|
nbviewer links / typo (#346)
* fixed typo
* removed remaining nbviewer links
* Update mha-implementations.ipynb
---------
Co-authored-by: Sebastian Raschka <mail@sebastianraschka.com>
|
2024-09-07 07:27:28 +02:00 |
|
Sebastian Raschka
|
ad12c8da06
|
Einsum multi-head attention (#345)
* Einsum multi-head attention
* update diff
|
2024-09-05 18:24:33 +02:00 |
|
Gustavo Monti
|
34e16991bb
|
updating REAMDE from chapter 02 inclund 04_bonus section (#344)
* updating REAMDE from chapter 02 inclund 04_bonus section
* Update ch02/README.md
---------
Co-authored-by: Gustavo Monti Rocha <gustavo.rocha@intelliway.com.br>
Co-authored-by: Sebastian Raschka <mail@sebastianraschka.com>
|
2024-09-05 08:09:46 +02:00 |
|
Sebastian Raschka
|
91db4e3a0f
|
Revert nbviewer links
|
2024-09-05 08:09:33 +02:00 |
|
rasbt
|
9de277421e
|
consistent header for appendix E
|
2024-08-30 08:08:01 +02:00 |
|