97 Commits

Author SHA1 Message Date
Sebastian Raschka
7a9a17608d Add user interface to ch06 and ch07 (#366)
* Add user interface to ch06 and ch07

* pep8

* fix url
2024-09-21 20:33:00 -05:00
rasbt
79ba591fbc Clarify API usage limits in bonus content 2024-09-15 08:05:04 -05:00
Jinge Wang
0dbc203f66 Fix 2 typos in 04_preferene-tuning-with-dpo (#356) 2024-09-15 07:36:22 -05:00
rasbt
3b9592830d clarifications 2024-09-11 20:16:35 -05:00
rasbt
435f153dac update title 2024-09-10 21:43:32 -05:00
Sebastian Raschka
f6f9825098 reflection-tuning dataset generation (#349) 2024-09-10 21:42:12 -05:00
rasbt
ce80a192cd refresh figures 2024-08-27 08:26:40 +02:00
Sebastian Raschka
a82169290e Note about MPS in ch06 and ch07 (#325) 2024-08-19 08:11:33 -05:00
Sebastian Raschka
bb73efb5cf Consistency update in README.md 2024-08-13 07:33:10 -05:00
rasbt
7a5771932b note about logistic sigmoid 2024-08-06 19:48:30 -05:00
rasbt
9ef132bb64 note about logistic sigmoid 2024-08-06 19:48:06 -05:00
rasbt
2245f8d9c1 extend equation description 2024-08-06 19:46:50 -05:00
rasbt
a65e06ff99 add more explanations 2024-08-06 19:45:11 -05:00
rasbt
089901db26 small figure update 2024-08-05 17:57:16 -05:00
Daniel Kleine
dcdf04e3bd minor DPO fixes (#298)
* fixed issues, updated .gitignore

* added closing paren

* fixed CEL spelling

* fixed more minor issues

* Update ch07/01_main-chapter-code/ch07.ipynb

* Update ch07/04_preference-tuning-with-dpo/dpo-from-scratch.ipynb

* Update ch07/04_preference-tuning-with-dpo/dpo-from-scratch.ipynb

* Update ch07/04_preference-tuning-with-dpo/dpo-from-scratch.ipynb

---------

Co-authored-by: Sebastian Raschka <mail@sebastianraschka.com>
2024-08-05 08:40:46 -05:00
rasbt
6030071e3f update model path 2024-08-05 07:36:08 -05:00
rasbt
f302f5e8d5 improve latex rendering in dpo notebook 2024-08-04 09:19:59 -05:00
Sebastian Raschka
09dc080cf3 Direct Preference Optimization from scratch (#294) 2024-08-04 08:57:36 -05:00
rasbt
ce33e706ba Fix 8-billion-parameter spelling 2024-07-28 10:48:56 -05:00
Daniel Kleine
60752e3b3a fixed typos and formatting (#291) 2024-07-28 10:04:33 -05:00
rasbt
7eb3f941a4 update figure caption 2024-07-27 13:30:18 -05:00
rasbt
4a0a8cd9e4 formatting 2024-07-27 09:51:24 -05:00
Sebastian Raschka
2b7bd46a93 Generate preference dataset with Llama 3.1 70B (#289) 2024-07-27 09:44:04 -05:00
Sebastian Raschka
6dd8666d9c Test code in pytorch 2.4 (#285)
* test code in pytorch 2.4

* update
2024-07-24 21:53:41 -05:00
rasbt
5d8a0c22ab use utf-8 encoding in json 2024-07-22 07:01:54 -05:00
Sebastian Raschka
d0f3b034d8 Add download help message (#274) 2024-07-19 08:29:29 -05:00
rasbt
3195594680 explain extra padding token 2024-07-17 07:38:25 -05:00
Jeroen Van Goey
70cfced899 fix typos, add codespell pre-commit hook (#264)
* fix typos, add codespell pre-commit hook

* Update .pre-commit-config.yaml

---------

Co-authored-by: Sebastian Raschka <mail@sebastianraschka.com>
2024-07-16 07:07:04 -05:00
Sebastian Raschka
377c14c25e break long lines in ch07 (#263) 2024-07-13 07:26:23 -05:00
Sebastian Raschka
2ce1d16de0 show how to use the finetuned model 2024-07-09 06:43:26 -07:00
Daniel Kleine
87f47a281a fixed spelling typos (#258) 2024-07-03 07:47:33 -05:00
rasbt
2b379abf70 add spearman and kendall-tau analysis 2024-07-02 07:55:32 -05:00
Sebastian Raschka
2d8eacb0fa Fix links in summary sections (#254) 2024-06-29 07:51:31 -05:00
rasbt
5e24a042c1 add links to summary sections 2024-06-29 07:33:26 -05:00
Daniel Kleine
fb4e37ae15 fixed minor issues (#252)
* fixed typo

* fixed var name in md text
2024-06-29 06:38:25 -05:00
Sebastian Raschka
65d68097ee Use deterministic ollama settings (#250)
* deterministic ollama settings

* add missing file
2024-06-27 07:16:48 -05:00
Daniel Kleine
99058c3d07 minor fixes (#248)
* removed duplicated numpy req

* labels to array

* autopep8 NBs
2024-06-26 08:52:51 -05:00
Daniel Kleine
7a54d383e7 minor fixes (#246)
* removed duplicated white spaces

* Update ch07/01_main-chapter-code/ch07.ipynb

* Update ch07/05_dataset-generation/llama3-ollama.ipynb

* removed duplicated white spaces

* fixed title again

---------

Co-authored-by: Sebastian Raschka <mail@sebastianraschka.com>
2024-06-25 17:30:30 -05:00
Sebastian Raschka
5629d4d147 Update title 2024-06-25 10:01:12 -05:00
Sebastian Raschka
1c89f0fc93 Generating a synthetic dataset for instruction finetuning (#245)
* Generating a synthetic dataset for instruction finetuning

* fix link
2024-06-23 21:48:25 -05:00
rasbt
530fa48d3f refresh figures 2024-06-23 10:41:29 -05:00
Sebastian Raschka
b7a7ac6068 removes redundent figsize code (#244) 2024-06-23 09:24:07 -05:00
Sebastian Raschka
1002f3079d Update README.md 2024-06-23 08:25:01 -05:00
Sebastian Raschka
def84a039c Show epochs as integers on x-axis (#241)
* Show epochs as integers on x-axis

* Update ch07/01_main-chapter-code/previous_chapters.py

* remove extra s

* modify exercise plots

* update chapter 7 plot

* resave ch07 for better file diff
2024-06-23 07:41:25 -05:00
Daniel Kleine
36a29e783a fixed typo (#243)
* fixed copy-paste typo

* Update ch07/01_main-chapter-code/ch07.ipynb

* Update ch07/01_main-chapter-code/ch07.ipynb

* Update ch07/01_main-chapter-code/ch07.ipynb

* Update ch07/01_main-chapter-code/ch07.ipynb

---------

Co-authored-by: Sebastian Raschka <mail@sebastianraschka.com>
2024-06-23 07:11:04 -05:00
Daniel Kleine
82c06420ac updated .gitignore for ch07/01 artefacts (#242)
* fixed markdown

* removed redundant imports

* updated .gitignore for ch07/01 artefacts
2024-06-22 18:12:01 -05:00
rasbt
519bfd6dc5 spelling fix 2024-06-22 12:22:21 -05:00
rasbt
549e015548 simplify 2024-06-22 11:10:05 -05:00
Sebastian Raschka
2ffedf5b98 Exercise solution for LoRA instruction finetuning (#240) 2024-06-22 10:05:32 -05:00
Sebastian Raschka
eb85c43bc3 Add CI tests for chapter 7 (#239) 2024-06-22 08:57:18 -05:00