729 Commits

Author SHA1 Message Date
Sebastian Raschka
3c3dae0967 Add mean pooling experiment to classifier bonus experiments (#406)
* Add mean pooling experiment to classifier bonus  experiments

* formatting

* add average embeddings option

* pep8
2024-10-20 11:04:18 -05:00
Sebastian Raschka
c4bac22bff Test PyTorch 2.5 (#405) 2024-10-20 10:23:31 -05:00
Sebastian Raschka
42b703fc0b Note about SSL certificates (#404) 2024-10-19 16:27:19 -05:00
rasbt
3567fb656d update mmap section 2024-10-14 14:27:19 -05:00
rasbt
31fb74133a add mmap=True comparison 2024-10-14 11:09:55 -05:00
Sebastian Raschka
3d54af20f5 Memory efficient weight loading (#401)
* memory efficient weight loading

* remove unused code
2024-10-14 10:30:25 -05:00
rasbt
59a5c83726 remove redundant code line 2024-10-13 15:58:11 -05:00
Sebastian Raschka
6a9bedc2ec Update bonus section formatting (#400) 2024-10-12 10:26:08 -05:00
Sebastian Raschka
35ecca0feb Update check-links.yml 2024-10-11 12:20:49 -05:00
rasbt
76d0807eab update card 2024-10-11 12:15:01 -05:00
rasbt
c36f623472 update reference numbers 2024-10-11 12:13:10 -05:00
Sebastian Raschka
b66d846cf6 Add MFU formula as reference material (#395)
* add MFU formula as reference material

* Update previous_chapters.py
2024-10-10 19:42:53 -05:00
Sebastian Raschka
1715aaacbc Update check-links.yml 2024-10-08 08:38:48 -05:00
Sebastian Raschka
37db3f0913 Add Llama 3.2 RoPE to CI (#391)
* add Llama 3.2 RoPE to CI

* update
2024-10-08 08:28:34 -05:00
Sebastian Raschka
06604f4b84 Introduce buffers to improve Llama 3.2 efficiency (#389)
* Introduce buffers to improve Llama 3.2 efficiency

* update

* update
2024-10-06 12:49:04 -05:00
Daniel Kleine
4f9775d91c fixed Llama 2 to 3.2 NBs (#388)
* updated requirements

* fixes llama2 to llama3

* fixed llama 3.2 standalone

* fixed typo

* fixed rope formula

* Update requirements-extra.txt

* Update ch05/07_gpt_to_llama/converting-llama2-to-llama3.ipynb

* Update ch05/07_gpt_to_llama/converting-llama2-to-llama3.ipynb

* Update ch05/07_gpt_to_llama/standalone-llama32.ipynb

---------

Co-authored-by: Sebastian Raschka <mail@sebastianraschka.com>
2024-10-06 09:56:55 -05:00
Sebastian Raschka
81053ccadd Add a note about weight tying in Llama 3.2 (#386) 2024-10-05 09:20:54 -05:00
Sebastian Raschka
58c3bb3d9d Llama 3 (#384)
* Implement Llama 3.2

* Add Llama 3.2 files

* exclude IMDB link because stanford website seems down
2024-10-05 07:52:15 -05:00
Sebastian Raschka
8d6b25785d Llama 3.2 requirements file 2024-10-05 07:32:43 -05:00
Sebastian Raschka
6f86c78763 Implement Llama 3.2 (#383) 2024-10-05 07:30:47 -05:00
Sebastian Raschka
d313f61c86 Cos-sin fix in Llama 2 bonus notebook (#381) 2024-10-03 20:45:40 -05:00
Sebastian Raschka
feb0647c79 Improve rope settings for llama3 (#380) 2024-10-03 08:29:54 -05:00
rasbt
2ae4ad15ba add section numbers 2024-09-30 08:42:22 -05:00
Sebastian Raschka
505e9a5fa5 Improve DDP on Windows (#376)
* Update DDP-script.py for Windows

* Windows handling

---------

Co-authored-by: Nathan Brown <nathan@nkbrown.us>
2024-09-29 16:53:48 -05:00
rasbt
58d0ce83a4 llama note 2024-09-26 07:41:11 -05:00
Sebastian Raschka
68505fab64 Fix truncation issue in classify_review function (#373) 2024-09-25 19:54:36 -05:00
Sebastian Raschka
b8497c1bf5 Add llama2 unit tests (#372)
* add llama2 unit tests

* update

* updates

* updates

* update file path

* update requirements file

* rmsnorm test

* update
2024-09-25 19:40:36 -05:00
rasbt
a23fca84d5 improve formatting 2024-09-24 18:49:17 -05:00
Daniel Kleine
4541177063 ch05/07 gpt_to_llama text improvements (#369)
* fixed typo

* fixed RMSnorm formula

* fixed SwiGLU formula

* temperature=0 for untrained model for reproducibility

* added extra info hf token
2024-09-24 18:45:49 -05:00
rasbt
941629d2c7 add json import 2024-09-23 09:12:35 -05:00
rasbt
835832a0f9 move access token to config.json 2024-09-23 08:56:16 -05:00
rasbt
5e6c7230ac add llama3 comparison 2024-09-23 08:17:10 -05:00
Sebastian Raschka
c38b003aa9 GPT to Llama (#368)
* GPT to Llama

* fix urls
2024-09-23 07:34:06 -05:00
rasbt
7e35370518 note about random numbers 2024-09-22 12:02:03 -05:00
Daniel Kleine
9bc5a7dd65 removed unnecessary imports (#367) 2024-09-22 11:59:37 -05:00
Sebastian Raschka
7a9a17608d Add user interface to ch06 and ch07 (#366)
* Add user interface to ch06 and ch07

* pep8

* fix url
2024-09-21 20:33:00 -05:00
rasbt
0f395921d7 remove unused function from user interface 2024-09-21 14:17:35 -05:00
Sebastian Raschka
081676d8dd Add missing bullet point 2024-09-21 12:59:12 -05:00
Sebastian Raschka
2aa964765e update gpt-2 paper url 2024-09-20 07:00:06 -07:00
Daniel Kleine
92ad9570e4 Chainlit bonus material fixes (#361)
* fix cmd

* moved idx to device

* improved code with clone().detach()

* fixed path

* fix: added extra line for pep8

* updated .gitginore

* Update ch05/06_user_interface/app_orig.py

* Update ch05/06_user_interface/app_own.py

* Apply suggestions from code review

---------

Co-authored-by: Sebastian Raschka <mail@sebastianraschka.com>
2024-09-18 08:08:50 -07:00
Sebastian Raschka
1bc560fb13 Add chatpgpt-like user interface (#360)
* Add chatpgpt-like user interface

* fixes
2024-09-17 08:26:44 -05:00
rasbt
53d61d8d94 update link checking 2024-09-15 08:16:23 -05:00
rasbt
79ba591fbc Clarify API usage limits in bonus content 2024-09-15 08:05:04 -05:00
Daniel Kleine
a72b5079e3 improved .vscode setup instructions (#353)
* improved .vscode project setup

* fixed spell check

* add missing 'p'

* Update README.md

---------

Co-authored-by: Sebastian Raschka <mail@sebastianraschka.com>
2024-09-15 07:43:43 -05:00
Jinge Wang
0dbc203f66 Fix 2 typos in 04_preferene-tuning-with-dpo (#356) 2024-09-15 07:36:22 -05:00
rasbt
adbcf8c7b6 update setup guide 2024-09-13 08:16:53 -05:00
Mingyuan Xu
21e6971b11 Run generate example in ch06 optionally on GPU (#352)
* model.to("cuda")

model.to("cuda")

* update device placement

---------

Co-authored-by: rasbt <mail@sebastianraschka.com>
2024-09-13 08:01:52 -05:00
rasbt
0da32f3976 Clarify extension instalation 2024-09-12 07:59:17 -05:00
Sebastian Raschka
58f0872013 Simplify conda section 2024-09-11 21:17:59 -05:00
rasbt
3b9592830d clarifications 2024-09-11 20:16:35 -05:00