rasbt
a23fca84d5
improve formatting
2024-09-24 18:49:17 -05:00
Daniel Kleine
4541177063
ch05/07 gpt_to_llama text improvements ( #369 )
...
* fixed typo
* fixed RMSnorm formula
* fixed SwiGLU formula
* temperature=0 for untrained model for reproducibility
* added extra info hf token
2024-09-24 18:45:49 -05:00
rasbt
941629d2c7
add json import
2024-09-23 09:12:35 -05:00
rasbt
835832a0f9
move access token to config.json
2024-09-23 08:56:16 -05:00
rasbt
5e6c7230ac
add llama3 comparison
2024-09-23 08:17:10 -05:00
Sebastian Raschka
c38b003aa9
GPT to Llama ( #368 )
...
* GPT to Llama
* fix urls
2024-09-23 07:34:06 -05:00
rasbt
7e35370518
note about random numbers
2024-09-22 12:02:03 -05:00
Daniel Kleine
9bc5a7dd65
removed unnecessary imports ( #367 )
2024-09-22 11:59:37 -05:00
Sebastian Raschka
7a9a17608d
Add user interface to ch06 and ch07 ( #366 )
...
* Add user interface to ch06 and ch07
* pep8
* fix url
2024-09-21 20:33:00 -05:00
rasbt
0f395921d7
remove unused function from user interface
2024-09-21 14:17:35 -05:00
Sebastian Raschka
081676d8dd
Add missing bullet point
2024-09-21 12:59:12 -05:00
Sebastian Raschka
2aa964765e
update gpt-2 paper url
2024-09-20 07:00:06 -07:00
Daniel Kleine
92ad9570e4
Chainlit bonus material fixes ( #361 )
...
* fix cmd
* moved idx to device
* improved code with clone().detach()
* fixed path
* fix: added extra line for pep8
* updated .gitginore
* Update ch05/06_user_interface/app_orig.py
* Update ch05/06_user_interface/app_own.py
* Apply suggestions from code review
---------
Co-authored-by: Sebastian Raschka <mail@sebastianraschka.com>
2024-09-18 08:08:50 -07:00
Sebastian Raschka
1bc560fb13
Add chatpgpt-like user interface ( #360 )
...
* Add chatpgpt-like user interface
* fixes
2024-09-17 08:26:44 -05:00
rasbt
53d61d8d94
update link checking
2024-09-15 08:16:23 -05:00
rasbt
79ba591fbc
Clarify API usage limits in bonus content
2024-09-15 08:05:04 -05:00
Daniel Kleine
a72b5079e3
improved .vscode setup instructions ( #353 )
...
* improved .vscode project setup
* fixed spell check
* add missing 'p'
* Update README.md
---------
Co-authored-by: Sebastian Raschka <mail@sebastianraschka.com>
2024-09-15 07:43:43 -05:00
Jinge Wang
0dbc203f66
Fix 2 typos in 04_preferene-tuning-with-dpo ( #356 )
2024-09-15 07:36:22 -05:00
rasbt
adbcf8c7b6
update setup guide
2024-09-13 08:16:53 -05:00
Mingyuan Xu
21e6971b11
Run generate example in ch06 optionally on GPU ( #352 )
...
* model.to("cuda")
model.to("cuda")
* update device placement
---------
Co-authored-by: rasbt <mail@sebastianraschka.com>
2024-09-13 08:01:52 -05:00
rasbt
0da32f3976
Clarify extension instalation
2024-09-12 07:59:17 -05:00
Sebastian Raschka
58f0872013
Simplify conda section
2024-09-11 21:17:59 -05:00
rasbt
3b9592830d
clarifications
2024-09-11 20:16:35 -05:00
rasbt
435f153dac
update title
2024-09-10 21:43:32 -05:00
Sebastian Raschka
f6f9825098
reflection-tuning dataset generation ( #349 )
2024-09-10 21:42:12 -05:00
rasbt
f57088285b
update gpt-2 paper link
2024-09-09 06:31:28 -05:00
rasbt
e105df0ced
update gpt-2 paper link
2024-09-08 15:49:44 -05:00
rasbt
3cebcce639
minor spelling fix
2024-09-08 15:35:36 -05:00
Daniel Kleine
9674e62166
nbviewer links / typo ( #346 )
...
* fixed typo
* removed remaining nbviewer links
* Update mha-implementations.ipynb
---------
Co-authored-by: Sebastian Raschka <mail@sebastianraschka.com>
2024-09-07 07:27:28 +02:00
Sebastian Raschka
9bb203b1b7
Einsum multi-head attention ( #345 )
...
* Einsum multi-head attention
* update diff
2024-09-05 18:24:33 +02:00
Gustavo Monti
190910e3d6
updating REAMDE from chapter 02 inclund 04_bonus section ( #344 )
...
* updating REAMDE from chapter 02 inclund 04_bonus section
* Update ch02/README.md
---------
Co-authored-by: Gustavo Monti Rocha <gustavo.rocha@intelliway.com.br>
Co-authored-by: Sebastian Raschka <mail@sebastianraschka.com>
2024-09-05 08:09:46 +02:00
Sebastian Raschka
e8b29c886a
Revert nbviewer links
2024-09-05 08:09:33 +02:00
rasbt
be31eaf418
consistent header for appendix E
2024-08-30 08:08:01 +02:00
Sebastian Raschka
de9ec16570
use nbviewer links ( #339 )
2024-08-29 09:09:10 +02:00
rasbt
ce80a192cd
refresh figures
2024-08-27 08:26:40 +02:00
Daniel Kleine
95926535f8
ch06/03 fixes ( #336 )
...
* fixed bash commands
* fixed help docstrings
* added missing logreg bash cmd
* Update train_bert_hf.py
* Update train_bert_hf_spam.py
* Update README.md
---------
Co-authored-by: Sebastian Raschka <mail@sebastianraschka.com>
2024-08-27 08:23:25 +02:00
rasbt
8eb6fc0ad0
sklearn baseline and roberta-large update
2024-08-26 10:31:54 +02:00
TITC
5acab58d41
add RoBERTa and params frozen ( #335 )
...
* add roberta experiment result
* add roberta & params frozen
* Update README.md
* modify lr
* modify lr
---------
Co-authored-by: Sebastian Raschka <mail@sebastianraschka.com>
2024-08-26 10:27:09 +02:00
Sebastian Raschka
12655594d5
Update README.md
2024-08-24 07:22:18 -05:00
Sebastian Raschka
296a91afb8
add BERT experiment results ( #333 )
...
* add BERT experiment results
* cleanup
* formatting
2024-08-23 08:40:40 -05:00
Sebastian Raschka
7cbfe418bf
grammar fix
2024-08-21 19:16:21 -05:00
Sebastian Raschka
092b5b5429
topk comment
2024-08-20 20:44:15 -05:00
rasbt
f4e45a3f40
add note about duplicated cell
2024-08-19 21:04:18 -05:00
Sebastian Raschka
11e2f56af5
Note about MPS devices ( #329 )
2024-08-19 20:58:45 -05:00
Sebastian Raschka
a82169290e
Note about MPS in ch06 and ch07 ( #325 )
2024-08-19 08:11:33 -05:00
Sebastian Raschka
0991c1ff24
Note about ch05 mps support ( #324 )
2024-08-19 07:40:24 -05:00
rasbt
1a962f3983
update lora experiments
2024-08-16 08:57:46 -05:00
rasbt
742525cb28
remove redundant indentation
2024-08-16 07:54:02 -05:00
TITC
70a7cddf9c
typo fix ( #323 )
2024-08-16 06:57:30 -05:00
TITC
e1072bbcd6
typo fix ( #321 )
...
* typo fix
experiment 5 is the same size as experiment 1, both are 124 Million. and experiment 6 is 355M ~3x 124M.
* typo fix
all layer FT vs all layer FT, "slightly worse by 1.3% " indicates it's exp 5 vs exp 9
* exp 5 vs 9
* Update ch06/02_bonus_additional-experiments/README.md
---------
Co-authored-by: Sebastian Raschka <mail@sebastianraschka.com>
2024-08-15 08:45:34 -05:00
