51 Commits

Author SHA1 Message Date
Sebastian Raschka
a22d612be6
Bonus material: extending tokenizers (#496)
* Bonus material: extending tokenizers

* small wording update
2025-01-22 09:26:54 -06:00
Sebastian Raschka
2d7ca7ee4b
fix ch07 unit test (#470) 2025-01-05 17:40:57 -06:00
Sebastian Raschka
701090815e
Add backup URL for gpt2 weights (#469)
* Add backup URL for gpt2 weights

* newline
2025-01-05 11:28:09 -06:00
Sebastian Raschka
f4ed263847
Add "What's next" section (#432)
* Add What's next section

* Delete appendix-D/01_main-chapter-code/appendix-D-Copy2.ipynb

* Delete ch03/01_main-chapter-code/ch03-Copy1.ipynb

* Delete appendix-D/01_main-chapter-code/appendix-D-Copy1.ipynb

* Update ch07.ipynb

* Update ch07.ipynb
2024-11-07 20:12:59 -06:00
rasbt
3760adbd3d
refresh figures 2024-08-27 08:26:40 +02:00
Sebastian Raschka
c443035d56
Note about MPS in ch06 and ch07 (#325) 2024-08-19 08:11:33 -05:00
rasbt
26df0c474c
note about logistic sigmoid 2024-08-06 19:48:06 -05:00
Daniel Kleine
8318d1f002
minor DPO fixes (#298)
* fixed issues, updated .gitignore

* added closing paren

* fixed CEL spelling

* fixed more minor issues

* Update ch07/01_main-chapter-code/ch07.ipynb

* Update ch07/04_preference-tuning-with-dpo/dpo-from-scratch.ipynb

* Update ch07/04_preference-tuning-with-dpo/dpo-from-scratch.ipynb

* Update ch07/04_preference-tuning-with-dpo/dpo-from-scratch.ipynb

---------

Co-authored-by: Sebastian Raschka <mail@sebastianraschka.com>
2024-08-05 08:40:46 -05:00
rasbt
a7869ad2bf
Fix 8-billion-parameter spelling 2024-07-28 10:48:56 -05:00
rasbt
9eb2e2a5f6
update figure caption 2024-07-27 13:30:18 -05:00
Sebastian Raschka
08040f024c
Test code in pytorch 2.4 (#285)
* test code in pytorch 2.4

* update
2024-07-24 21:53:41 -05:00
rasbt
46fcde15d8
use utf-8 encoding in json 2024-07-22 07:01:54 -05:00
Sebastian Raschka
8d02cb1cee
Add download help message (#274) 2024-07-19 08:29:29 -05:00
rasbt
be14f06442
explain extra padding token 2024-07-17 07:38:25 -05:00
Sebastian Raschka
e0148f6ecc
break long lines in ch07 (#263) 2024-07-13 07:26:23 -05:00
Sebastian Raschka
4f0a107692 show how to use the finetuned model 2024-07-09 06:43:26 -07:00
Daniel Kleine
90b25ece3d
fixed spelling typos (#258) 2024-07-03 07:47:33 -05:00
Sebastian Raschka
f6bcdd37bd
Fix links in summary sections (#254) 2024-06-29 07:51:31 -05:00
rasbt
31806828d0
add links to summary sections 2024-06-29 07:33:26 -05:00
Daniel Kleine
1e69c8e0b5
fixed minor issues (#252)
* fixed typo

* fixed var name in md text
2024-06-29 06:38:25 -05:00
Sebastian Raschka
e296e8f6be
Use deterministic ollama settings (#250)
* deterministic ollama settings

* add missing file
2024-06-27 07:16:48 -05:00
Daniel Kleine
81c843bdc0
minor fixes (#246)
* removed duplicated white spaces

* Update ch07/01_main-chapter-code/ch07.ipynb

* Update ch07/05_dataset-generation/llama3-ollama.ipynb

* removed duplicated white spaces

* fixed title again

---------

Co-authored-by: Sebastian Raschka <mail@sebastianraschka.com>
2024-06-25 17:30:30 -05:00
rasbt
0734570b28
refresh figures 2024-06-23 10:41:29 -05:00
Sebastian Raschka
4c69df6070
removes redundent figsize code (#244) 2024-06-23 09:24:07 -05:00
Sebastian Raschka
cf0df54d7d
Show epochs as integers on x-axis (#241)
* Show epochs as integers on x-axis

* Update ch07/01_main-chapter-code/previous_chapters.py

* remove extra s

* modify exercise plots

* update chapter 7 plot

* resave ch07 for better file diff
2024-06-23 07:41:25 -05:00
Daniel Kleine
51ca343e83
fixed typo (#243)
* fixed copy-paste typo

* Update ch07/01_main-chapter-code/ch07.ipynb

* Update ch07/01_main-chapter-code/ch07.ipynb

* Update ch07/01_main-chapter-code/ch07.ipynb

* Update ch07/01_main-chapter-code/ch07.ipynb

---------

Co-authored-by: Sebastian Raschka <mail@sebastianraschka.com>
2024-06-23 07:11:04 -05:00
Daniel Kleine
3ac363d005
updated .gitignore for ch07/01 artefacts (#242)
* fixed markdown

* removed redundant imports

* updated .gitignore for ch07/01 artefacts
2024-06-22 18:12:01 -05:00
rasbt
523a3b9bb4
spelling fix 2024-06-22 12:22:21 -05:00
rasbt
c21b9937e9
simplify 2024-06-22 11:10:05 -05:00
Sebastian Raschka
72f46297d9
Exercise solution for LoRA instruction finetuning (#240) 2024-06-22 10:05:32 -05:00
Sebastian Raschka
ec5baa1f33
Add CI tests for chapter 7 (#239) 2024-06-22 08:57:18 -05:00
Sebastian Raschka
b90c7ad2d6
Exercise solutions (#237) 2024-06-22 08:30:45 -05:00
rasbt
4c2b503785
update 2024-06-21 06:31:31 -05:00
Sebastian Raschka
6c0dc2362b
Add standalone finetuning and evaluation scripts for chapter 7 (#234)
* add finetuning and eval scripts

* update link

* update links

* fix link
2024-06-21 05:23:24 -05:00
Sebastian Raschka
8ccca3a882
Add standalone instruction finetuning script (#233) 2024-06-20 07:37:47 -05:00
rasbt
c595f3da3f
example code to use the finetuned model 2024-06-19 20:21:14 -05:00
rasbt
8773981de0
consistency 2024-06-19 19:47:31 -05:00
rasbt
283397aaf2
add main and optional sections 2024-06-19 17:48:25 -05:00
Daniel Kleine
bbb2a0c3d5
fixed num_workers (#229)
* fixed num_workers

* ch06 & ch07: added num_workers to create_dataloader_v1
2024-06-19 17:36:46 -05:00
Daniel Kleine
44cda14494
minor: fixed API name (#227)
* fixed api name

* Update ch07/01_main-chapter-code/ch07.ipynb

---------

Co-authored-by: Sebastian Raschka <mail@sebastianraschka.com>
2024-06-19 07:09:32 -05:00
Jinge Wang
8d43b4bfea
Fix some typos in ch07.ipynb (#224)
* Fixed some typos in ch06.ipynb

* Fix some typos in ch07.ipynb
2024-06-19 06:14:25 -05:00
Sebastian Raschka
1ba1bb4c77
add mps runtime (#223) 2024-06-18 20:58:59 -05:00
rasbt
7b2174b115
formating updates 2024-06-17 07:40:04 -05:00
rasbt
f6274117b9
formatting 2024-06-16 08:27:25 -05:00
Sebastian Raschka
aba7ed2eb1
Updated ch07 (#213)
* Updated ch07

* fix links

* check links
2024-06-15 15:10:01 -05:00
Sebastian Raschka
1a65020d81
Add eos token to each response (#205)
* add eos token to each response

* remove figure
2024-06-11 08:57:12 -05:00
rasbt
101f3b949a
add performance of llama 3 models for reference 2024-06-10 18:21:58 -05:00
Daniel Kleine
da9f64215a
ch07 fixes (#204)
* updated .gitginore for ch07

* fixed extract_response()
2024-06-10 17:31:13 -05:00
rasbt
888ce71796 reorg first section 2024-06-10 08:20:12 -05:00
Sebastian Raschka
4eea9ce12c
ch07 first draft (#203) 2024-06-09 10:35:26 -05:00