Sebastian Raschka
|
895512ebee
|
Revert accidental edit
|
2024-08-06 19:54:34 -05:00 |
|
rasbt
|
7a5771932b
|
note about logistic sigmoid
|
2024-08-06 19:48:30 -05:00 |
|
rasbt
|
9ef132bb64
|
note about logistic sigmoid
|
2024-08-06 19:48:06 -05:00 |
|
rasbt
|
2245f8d9c1
|
extend equation description
|
2024-08-06 19:46:50 -05:00 |
|
rasbt
|
a65e06ff99
|
add more explanations
|
2024-08-06 19:45:11 -05:00 |
|
Sebastian Raschka
|
b1a420c8ca
|
Update README.md
|
2024-08-06 08:02:01 -05:00 |
|
TITC
|
7374d617b4
|
total training iters may equal to warmup_iters (#301)
total_training_iters=20, warmup_iters=20= len(train_loader) 4 multiply n_epochs 5, then ZeroDivisionError occurred.
```shell
Traceback (most recent call last):
File "LLMs-from-scratch/ch05/05_bonus_hparam_tuning/hparam_search.py", line 191, in <module>
train_loss, val_loss = train_model(
^^^^^^^^^^^^
File "/mnt/raid1/docker/ai/LLMs-from-scratch/ch05/05_bonus_hparam_tuning/hparam_search.py", line 90, in train_model
progress = (global_step - warmup_iters) / (total_training_iters - warmup_iters)
~~~~~~~~~~~~~~~~~~~~~~~~~~~^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
ZeroDivisionError: division by zero
```
|
2024-08-06 07:10:05 -05:00 |
|
Sebastian Raschka
|
192bdc3501
|
improve gradient accumulation (#300)
|
2024-08-05 18:27:20 -05:00 |
|
rasbt
|
089901db26
|
small figure update
|
2024-08-05 17:57:16 -05:00 |
|
Sebastian Raschka
|
b39234fc25
|
Update README.md
|
2024-08-05 17:47:06 -05:00 |
|
Daniel Kleine
|
dcdf04e3bd
|
minor DPO fixes (#298)
* fixed issues, updated .gitignore
* added closing paren
* fixed CEL spelling
* fixed more minor issues
* Update ch07/01_main-chapter-code/ch07.ipynb
* Update ch07/04_preference-tuning-with-dpo/dpo-from-scratch.ipynb
* Update ch07/04_preference-tuning-with-dpo/dpo-from-scratch.ipynb
* Update ch07/04_preference-tuning-with-dpo/dpo-from-scratch.ipynb
---------
Co-authored-by: Sebastian Raschka <mail@sebastianraschka.com>
|
2024-08-05 08:40:46 -05:00 |
|
rasbt
|
6030071e3f
|
update model path
|
2024-08-05 07:36:08 -05:00 |
|
SSebo
|
22681878a8
|
Update ch05.ipynb (#297)
typo
|
2024-08-05 07:12:27 -05:00 |
|
Sebastian Raschka
|
e4ed2c91cc
|
Update README.md
|
2024-08-04 16:06:38 -05:00 |
|
rasbt
|
f302f5e8d5
|
improve latex rendering in dpo notebook
|
2024-08-04 09:19:59 -05:00 |
|
Sebastian Raschka
|
2c6cdb497f
|
Update matplotlib tests on Windows (#295)
|
2024-08-04 09:18:19 -05:00 |
|
Sebastian Raschka
|
09dc080cf3
|
Direct Preference Optimization from scratch (#294)
|
2024-08-04 08:57:36 -05:00 |
|
Sebastian Raschka
|
3ea0798d44
|
Update README.md
|
2024-08-01 18:17:42 -05:00 |
|
rasbt
|
eabeab04d1
|
restructure into local and cloud setup
|
2024-07-31 06:59:04 -05:00 |
|
Sebastian Raschka
|
b4b2ac668c
|
Add video tutorial
|
2024-07-30 06:57:46 -05:00 |
|
Sebastian Raschka
|
6c2d34b03d
|
Update README.md
|
2024-07-30 06:55:41 -05:00 |
|
rasbt
|
358717870b
|
add state_dict example
|
2024-07-28 14:15:32 -05:00 |
|
rasbt
|
ce33e706ba
|
Fix 8-billion-parameter spelling
|
2024-07-28 10:48:56 -05:00 |
|
Daniel Kleine
|
60752e3b3a
|
fixed typos and formatting (#291)
|
2024-07-28 10:04:33 -05:00 |
|
Sebastian Raschka
|
75a24c4897
|
Update README.md
|
2024-07-28 09:28:11 -05:00 |
|
Sebastian Raschka
|
011ee83ea7
|
Update README.md
|
2024-07-28 08:21:38 -05:00 |
|
Sebastian Raschka
|
1b86a61a2e
|
buffer tutorial
|
2024-07-27 17:06:16 -05:00 |
|
Sebastian Raschka
|
f66c089f0b
|
Test with PyTorch 2.0 and 2.4 (#290)
* Test with PyTorch 2.0 and 2.4
* Update basic-tests-old-pytorch.yml
* skip version cell
|
2024-07-27 15:09:02 -05:00 |
|
Sebastian Raschka
|
7bf0d13ee8
|
Update README.md
|
2024-07-27 13:39:23 -05:00 |
|
rasbt
|
7eb3f941a4
|
update figure caption
|
2024-07-27 13:30:18 -05:00 |
|
rasbt
|
4a0a8cd9e4
|
formatting
|
2024-07-27 09:51:24 -05:00 |
|
Sebastian Raschka
|
2b7bd46a93
|
Generate preference dataset with Llama 3.1 70B (#289)
|
2024-07-27 09:44:04 -05:00 |
|
rasbt
|
3da0f18da7
|
update
|
2024-07-27 07:12:42 -05:00 |
|
Sebastian Raschka
|
1e873d4cbc
|
Understanding PyTorch Buffers (#288)
|
2024-07-26 08:45:36 -05:00 |
|
Sebastian Raschka
|
6dd8666d9c
|
Test code in pytorch 2.4 (#285)
* test code in pytorch 2.4
* update
|
2024-07-24 21:53:41 -05:00 |
|
TITC
|
bce3a708f9
|
47,678-->48,725 (#281)
|
2024-07-22 21:24:57 -05:00 |
|
rasbt
|
5d8a0c22ab
|
use utf-8 encoding in json
|
2024-07-22 07:01:54 -05:00 |
|
Sebastian Raschka
|
3f6f2af3a3
|
Simplify embedding vs linear layer code (#278)
|
2024-07-21 12:21:10 -05:00 |
|
Sebastian Raschka
|
7356020b44
|
Update README.md
|
2024-07-21 10:42:28 -05:00 |
|
Sebastian Raschka
|
b80b14cf09
|
Update README.md
|
2024-07-21 10:41:53 -05:00 |
|
Sebastian Raschka
|
d0f3b034d8
|
Add download help message (#274)
|
2024-07-19 08:29:29 -05:00 |
|
Sebastian Raschka
|
06ed31f347
|
Updated test badges
|
2024-07-18 20:26:51 -05:00 |
|
rasbt
|
3195594680
|
explain extra padding token
|
2024-07-17 07:38:25 -05:00 |
|
Thanh Tran
|
a2bb045984
|
fix typos & inconsistent texts (#269)
Co-authored-by: TRAN <you@example.com>
|
2024-07-17 07:34:51 -05:00 |
|
rasbt
|
ee1d4730ba
|
fixes bold font #267
|
2024-07-16 17:51:15 -05:00 |
|
Sebastian Raschka
|
311a3837e4
|
Gh workflow for spelling errors (#265)
* Gh workflow for spelling errors
* add files to check
|
2024-07-16 08:17:20 -05:00 |
|
Jeroen Van Goey
|
70cfced899
|
fix typos, add codespell pre-commit hook (#264)
* fix typos, add codespell pre-commit hook
* Update .pre-commit-config.yaml
---------
Co-authored-by: Sebastian Raschka <mail@sebastianraschka.com>
|
2024-07-16 07:07:04 -05:00 |
|
rasbt
|
3b79631672
|
add missing "be" to figure
|
2024-07-15 08:06:05 -05:00 |
|
rasbt
|
2ab7a9aa9d
|
clarify libraries
|
2024-07-14 08:53:16 -05:00 |
|
Sebastian Raschka
|
377c14c25e
|
break long lines in ch07 (#263)
|
2024-07-13 07:26:23 -05:00 |
|