98 Commits

Author SHA1 Message Date
Sebastian Raschka
b6c4b2f9f1
Update bonus section formatting (#400) 2024-10-12 10:26:08 -05:00
Sebastian Raschka
76e9a9ec02
Add user interface to ch06 and ch07 (#366)
* Add user interface to ch06 and ch07

* pep8

* fix url
2024-09-21 20:33:00 -05:00
rasbt
6110858d5b
Clarify API usage limits in bonus content 2024-09-15 08:05:04 -05:00
Jinge Wang
4210386cec
Fix 2 typos in 04_preferene-tuning-with-dpo (#356) 2024-09-15 07:36:22 -05:00
rasbt
f1accdf273
clarifications 2024-09-11 20:16:35 -05:00
rasbt
fe2136e7c9
update title 2024-09-10 21:43:32 -05:00
Sebastian Raschka
835ed29dbf
reflection-tuning dataset generation (#349) 2024-09-10 21:42:12 -05:00
rasbt
3760adbd3d
refresh figures 2024-08-27 08:26:40 +02:00
Sebastian Raschka
c443035d56
Note about MPS in ch06 and ch07 (#325) 2024-08-19 08:11:33 -05:00
Sebastian Raschka
9713e70a20
Consistency update in README.md 2024-08-13 07:33:10 -05:00
rasbt
06151a809e
note about logistic sigmoid 2024-08-06 19:48:30 -05:00
rasbt
26df0c474c
note about logistic sigmoid 2024-08-06 19:48:06 -05:00
rasbt
e810f9f004
extend equation description 2024-08-06 19:46:50 -05:00
rasbt
c8090f30ef
add more explanations 2024-08-06 19:45:11 -05:00
rasbt
36fbc7aa74
small figure update 2024-08-05 17:57:16 -05:00
Daniel Kleine
8318d1f002
minor DPO fixes (#298)
* fixed issues, updated .gitignore

* added closing paren

* fixed CEL spelling

* fixed more minor issues

* Update ch07/01_main-chapter-code/ch07.ipynb

* Update ch07/04_preference-tuning-with-dpo/dpo-from-scratch.ipynb

* Update ch07/04_preference-tuning-with-dpo/dpo-from-scratch.ipynb

* Update ch07/04_preference-tuning-with-dpo/dpo-from-scratch.ipynb

---------

Co-authored-by: Sebastian Raschka <mail@sebastianraschka.com>
2024-08-05 08:40:46 -05:00
rasbt
36b9d5e0eb
update model path 2024-08-05 07:36:08 -05:00
rasbt
60aada801b
improve latex rendering in dpo notebook 2024-08-04 09:19:59 -05:00
Sebastian Raschka
52435804eb
Direct Preference Optimization from scratch (#294) 2024-08-04 08:57:36 -05:00
rasbt
a7869ad2bf
Fix 8-billion-parameter spelling 2024-07-28 10:48:56 -05:00
Daniel Kleine
9a3b04f92f
fixed typos and formatting (#291) 2024-07-28 10:04:33 -05:00
rasbt
9eb2e2a5f6
update figure caption 2024-07-27 13:30:18 -05:00
rasbt
c87e4364b7
formatting 2024-07-27 09:51:24 -05:00
Sebastian Raschka
99af403b9f
Generate preference dataset with Llama 3.1 70B (#289) 2024-07-27 09:44:04 -05:00
Sebastian Raschka
08040f024c
Test code in pytorch 2.4 (#285)
* test code in pytorch 2.4

* update
2024-07-24 21:53:41 -05:00
rasbt
46fcde15d8
use utf-8 encoding in json 2024-07-22 07:01:54 -05:00
Sebastian Raschka
8d02cb1cee
Add download help message (#274) 2024-07-19 08:29:29 -05:00
rasbt
be14f06442
explain extra padding token 2024-07-17 07:38:25 -05:00
Jeroen Van Goey
48bd72c890
fix typos, add codespell pre-commit hook (#264)
* fix typos, add codespell pre-commit hook

* Update .pre-commit-config.yaml

---------

Co-authored-by: Sebastian Raschka <mail@sebastianraschka.com>
2024-07-16 07:07:04 -05:00
Sebastian Raschka
e0148f6ecc
break long lines in ch07 (#263) 2024-07-13 07:26:23 -05:00
Sebastian Raschka
4f0a107692 show how to use the finetuned model 2024-07-09 06:43:26 -07:00
Daniel Kleine
90b25ece3d
fixed spelling typos (#258) 2024-07-03 07:47:33 -05:00
rasbt
f5a4f9dee3
add spearman and kendall-tau analysis 2024-07-02 07:55:32 -05:00
Sebastian Raschka
f6bcdd37bd
Fix links in summary sections (#254) 2024-06-29 07:51:31 -05:00
rasbt
31806828d0
add links to summary sections 2024-06-29 07:33:26 -05:00
Daniel Kleine
1e69c8e0b5
fixed minor issues (#252)
* fixed typo

* fixed var name in md text
2024-06-29 06:38:25 -05:00
Sebastian Raschka
e296e8f6be
Use deterministic ollama settings (#250)
* deterministic ollama settings

* add missing file
2024-06-27 07:16:48 -05:00
Daniel Kleine
1db1999951
minor fixes (#248)
* removed duplicated numpy req

* labels to array

* autopep8 NBs
2024-06-26 08:52:51 -05:00
Daniel Kleine
81c843bdc0
minor fixes (#246)
* removed duplicated white spaces

* Update ch07/01_main-chapter-code/ch07.ipynb

* Update ch07/05_dataset-generation/llama3-ollama.ipynb

* removed duplicated white spaces

* fixed title again

---------

Co-authored-by: Sebastian Raschka <mail@sebastianraschka.com>
2024-06-25 17:30:30 -05:00
Sebastian Raschka
9a9b3530c9
Update title 2024-06-25 10:01:12 -05:00
Sebastian Raschka
dbcdc7593b
Generating a synthetic dataset for instruction finetuning (#245)
* Generating a synthetic dataset for instruction finetuning

* fix link
2024-06-23 21:48:25 -05:00
rasbt
0734570b28
refresh figures 2024-06-23 10:41:29 -05:00
Sebastian Raschka
4c69df6070
removes redundent figsize code (#244) 2024-06-23 09:24:07 -05:00
Sebastian Raschka
f78ad1f95b
Update README.md 2024-06-23 08:25:01 -05:00
Sebastian Raschka
cf0df54d7d
Show epochs as integers on x-axis (#241)
* Show epochs as integers on x-axis

* Update ch07/01_main-chapter-code/previous_chapters.py

* remove extra s

* modify exercise plots

* update chapter 7 plot

* resave ch07 for better file diff
2024-06-23 07:41:25 -05:00
Daniel Kleine
51ca343e83
fixed typo (#243)
* fixed copy-paste typo

* Update ch07/01_main-chapter-code/ch07.ipynb

* Update ch07/01_main-chapter-code/ch07.ipynb

* Update ch07/01_main-chapter-code/ch07.ipynb

* Update ch07/01_main-chapter-code/ch07.ipynb

---------

Co-authored-by: Sebastian Raschka <mail@sebastianraschka.com>
2024-06-23 07:11:04 -05:00
Daniel Kleine
3ac363d005
updated .gitignore for ch07/01 artefacts (#242)
* fixed markdown

* removed redundant imports

* updated .gitignore for ch07/01 artefacts
2024-06-22 18:12:01 -05:00
rasbt
523a3b9bb4
spelling fix 2024-06-22 12:22:21 -05:00
rasbt
c21b9937e9
simplify 2024-06-22 11:10:05 -05:00
Sebastian Raschka
72f46297d9
Exercise solution for LoRA instruction finetuning (#240) 2024-06-22 10:05:32 -05:00