rasbt
c8090f30ef
add more explanations
2024-08-06 19:45:11 -05:00
rasbt
36fbc7aa74
small figure update
2024-08-05 17:57:16 -05:00
Daniel Kleine
8318d1f002
minor DPO fixes ( #298 )
...
* fixed issues, updated .gitignore
* added closing paren
* fixed CEL spelling
* fixed more minor issues
* Update ch07/01_main-chapter-code/ch07.ipynb
* Update ch07/04_preference-tuning-with-dpo/dpo-from-scratch.ipynb
* Update ch07/04_preference-tuning-with-dpo/dpo-from-scratch.ipynb
* Update ch07/04_preference-tuning-with-dpo/dpo-from-scratch.ipynb
---------
Co-authored-by: Sebastian Raschka <mail@sebastianraschka.com>
2024-08-05 08:40:46 -05:00
rasbt
36b9d5e0eb
update model path
2024-08-05 07:36:08 -05:00
rasbt
60aada801b
improve latex rendering in dpo notebook
2024-08-04 09:19:59 -05:00
Sebastian Raschka
52435804eb
Direct Preference Optimization from scratch ( #294 )
2024-08-04 08:57:36 -05:00
rasbt
a7869ad2bf
Fix 8-billion-parameter spelling
2024-07-28 10:48:56 -05:00
Daniel Kleine
9a3b04f92f
fixed typos and formatting ( #291 )
2024-07-28 10:04:33 -05:00
rasbt
9eb2e2a5f6
update figure caption
2024-07-27 13:30:18 -05:00
rasbt
c87e4364b7
formatting
2024-07-27 09:51:24 -05:00
Sebastian Raschka
99af403b9f
Generate preference dataset with Llama 3.1 70B ( #289 )
2024-07-27 09:44:04 -05:00
Sebastian Raschka
08040f024c
Test code in pytorch 2.4 ( #285 )
...
* test code in pytorch 2.4
* update
2024-07-24 21:53:41 -05:00
rasbt
46fcde15d8
use utf-8 encoding in json
2024-07-22 07:01:54 -05:00
Sebastian Raschka
8d02cb1cee
Add download help message ( #274 )
2024-07-19 08:29:29 -05:00
rasbt
be14f06442
explain extra padding token
2024-07-17 07:38:25 -05:00
Jeroen Van Goey
48bd72c890
fix typos, add codespell pre-commit hook ( #264 )
...
* fix typos, add codespell pre-commit hook
* Update .pre-commit-config.yaml
---------
Co-authored-by: Sebastian Raschka <mail@sebastianraschka.com>
2024-07-16 07:07:04 -05:00
Sebastian Raschka
e0148f6ecc
break long lines in ch07 ( #263 )
2024-07-13 07:26:23 -05:00
Sebastian Raschka
4f0a107692
show how to use the finetuned model
2024-07-09 06:43:26 -07:00
Daniel Kleine
90b25ece3d
fixed spelling typos ( #258 )
2024-07-03 07:47:33 -05:00
rasbt
f5a4f9dee3
add spearman and kendall-tau analysis
2024-07-02 07:55:32 -05:00
Sebastian Raschka
f6bcdd37bd
Fix links in summary sections ( #254 )
2024-06-29 07:51:31 -05:00
rasbt
31806828d0
add links to summary sections
2024-06-29 07:33:26 -05:00
Daniel Kleine
1e69c8e0b5
fixed minor issues ( #252 )
...
* fixed typo
* fixed var name in md text
2024-06-29 06:38:25 -05:00
Sebastian Raschka
e296e8f6be
Use deterministic ollama settings ( #250 )
...
* deterministic ollama settings
* add missing file
2024-06-27 07:16:48 -05:00
Daniel Kleine
1db1999951
minor fixes ( #248 )
...
* removed duplicated numpy req
* labels to array
* autopep8 NBs
2024-06-26 08:52:51 -05:00
Daniel Kleine
81c843bdc0
minor fixes ( #246 )
...
* removed duplicated white spaces
* Update ch07/01_main-chapter-code/ch07.ipynb
* Update ch07/05_dataset-generation/llama3-ollama.ipynb
* removed duplicated white spaces
* fixed title again
---------
Co-authored-by: Sebastian Raschka <mail@sebastianraschka.com>
2024-06-25 17:30:30 -05:00
Sebastian Raschka
9a9b3530c9
Update title
2024-06-25 10:01:12 -05:00
Sebastian Raschka
dbcdc7593b
Generating a synthetic dataset for instruction finetuning ( #245 )
...
* Generating a synthetic dataset for instruction finetuning
* fix link
2024-06-23 21:48:25 -05:00
rasbt
0734570b28
refresh figures
2024-06-23 10:41:29 -05:00
Sebastian Raschka
4c69df6070
removes redundent figsize code ( #244 )
2024-06-23 09:24:07 -05:00
Sebastian Raschka
f78ad1f95b
Update README.md
2024-06-23 08:25:01 -05:00
Sebastian Raschka
cf0df54d7d
Show epochs as integers on x-axis ( #241 )
...
* Show epochs as integers on x-axis
* Update ch07/01_main-chapter-code/previous_chapters.py
* remove extra s
* modify exercise plots
* update chapter 7 plot
* resave ch07 for better file diff
2024-06-23 07:41:25 -05:00
Daniel Kleine
51ca343e83
fixed typo ( #243 )
...
* fixed copy-paste typo
* Update ch07/01_main-chapter-code/ch07.ipynb
* Update ch07/01_main-chapter-code/ch07.ipynb
* Update ch07/01_main-chapter-code/ch07.ipynb
* Update ch07/01_main-chapter-code/ch07.ipynb
---------
Co-authored-by: Sebastian Raschka <mail@sebastianraschka.com>
2024-06-23 07:11:04 -05:00
Daniel Kleine
3ac363d005
updated .gitignore for ch07/01 artefacts ( #242 )
...
* fixed markdown
* removed redundant imports
* updated .gitignore for ch07/01 artefacts
2024-06-22 18:12:01 -05:00
rasbt
523a3b9bb4
spelling fix
2024-06-22 12:22:21 -05:00
rasbt
c21b9937e9
simplify
2024-06-22 11:10:05 -05:00
Sebastian Raschka
72f46297d9
Exercise solution for LoRA instruction finetuning ( #240 )
2024-06-22 10:05:32 -05:00
Sebastian Raschka
ec5baa1f33
Add CI tests for chapter 7 ( #239 )
2024-06-22 08:57:18 -05:00
Sebastian Raschka
b90c7ad2d6
Exercise solutions ( #237 )
2024-06-22 08:30:45 -05:00
Daniel Kleine
ad9dd994dc
minor fixes ( #235 )
...
* removed unnecessary imports
* removed unnecessary semicolons
* format markdown
* format markdown
* fixed markdown
2024-06-21 08:40:54 -05:00
rasbt
4c2b503785
update
2024-06-21 06:31:31 -05:00
Sebastian Raschka
6c0dc2362b
Add standalone finetuning and evaluation scripts for chapter 7 ( #234 )
...
* add finetuning and eval scripts
* update link
* update links
* fix link
2024-06-21 05:23:24 -05:00
Sebastian Raschka
8ccca3a882
Add standalone instruction finetuning script ( #233 )
2024-06-20 07:37:47 -05:00
rasbt
c595f3da3f
example code to use the finetuned model
2024-06-19 20:21:14 -05:00
rasbt
8773981de0
consistency
2024-06-19 19:47:31 -05:00
rasbt
283397aaf2
add main and optional sections
2024-06-19 17:48:25 -05:00
Daniel Kleine
bbb2a0c3d5
fixed num_workers ( #229 )
...
* fixed num_workers
* ch06 & ch07: added num_workers to create_dataloader_v1
2024-06-19 17:36:46 -05:00
Daniel Kleine
44cda14494
minor: fixed API name ( #227 )
...
* fixed api name
* Update ch07/01_main-chapter-code/ch07.ipynb
---------
Co-authored-by: Sebastian Raschka <mail@sebastianraschka.com>
2024-06-19 07:09:32 -05:00
Jinge Wang
8d43b4bfea
Fix some typos in ch07.ipynb ( #224 )
...
* Fixed some typos in ch06.ipynb
* Fix some typos in ch07.ipynb
2024-06-19 06:14:25 -05:00
Sebastian Raschka
1ba1bb4c77
add mps runtime ( #223 )
2024-06-18 20:58:59 -05:00