yujunjun/LLMs-from-scratch
1
0
Fork 0
mirror of https://github.com/rasbt/LLMs-from-scratch.git synced 2025-08-29 11:00:55 +00:00
Code Issues Packages Projects Releases Wiki Activity
810 Commits 8 Branches 0 Tags
Commit Graph

110 Commits

Author SHA1 Message Date
Sebastian Raschka
5016499d1d Uv workflow improvements (#531) 
* Uv workflow improvements

* Uv workflow improvements

* linter improvements

* pytproject.toml fixes

* pytproject.toml fixes

* pytproject.toml fixes

* pytproject.toml fixes

* pytproject.toml fixes

* pytproject.toml fixes

* windows fixes

* windows fixes

* windows fixes

* windows fixes

* windows fixes

* windows fixes

* win32 fix

* win32 fix

* win32 fix

* win32 fix

* win32 fix

* win32 fix

* win32 fix

* win32 fix

* win32 fix

* win32 fix

* win32 fix

* win32 fix

* win32 fix

* win32 fix

* win32 fix

* win32 fix

* win32 fix

* win32 fix

* win32 fix
 2025-02-16 13:16:51 -06:00
Sebastian Raschka
9dce43ec31 Upgrade to NumPy 2.0 (#520) 
* Upgrade to NumPy 2.0

* bump pytorch

* bump pytorch

* bump pytorch

* bump pytorch

* bump pytorch

* update

* update packages
 2025-02-09 06:21:58 -06:00
Sebastian Raschka
ebfc50f076 Fix default argument in ex 7.2 (#506) 2025-01-25 10:46:48 -06:00
Sebastian Raschka
d387696f93 A few cosmetic updates (#504) 2025-01-23 09:38:55 -06:00
Sebastian Raschka
dcaac28b92 Bonus material: extending tokenizers (#496) 
* Bonus material: extending tokenizers

* small wording update
 2025-01-22 09:26:54 -06:00
rasbt
bed5f89378 fix reward margins plot label in dpo nb 2025-01-12 14:04:05 -06:00
Sebastian Raschka
992f3068d1 Auto download DPO dataset if not already available in path (#479) 
* Auto download DPO dataset if not already available in path

* update tests to account for latest HF transformers release in unit tests

* pep 8
 2025-01-12 12:27:28 -06:00
Sebastian Raschka
05f2a398b8 adds no-grad context for reference model to DPO (#473) 2025-01-07 20:49:01 -06:00
Sebastian Raschka
b3dc7073ee fix ch07 unit test (#470) 2025-01-05 17:40:57 -06:00
Sebastian Raschka
7659af7cdd Add backup URL for gpt2 weights (#469) 
* Add backup URL for gpt2 weights

* newline
 2025-01-05 11:28:09 -06:00
QS
976c92010c typo fixed (#468) 
* typo fixed

* only update plot

---------

Co-authored-by: rasbt <mail@sebastianraschka.com>
 2025-01-05 09:17:13 -06:00
Sebastian Raschka
74e04a9169 Add "What's next" section (#432) 
* Add What's next section

* Delete appendix-D/01_main-chapter-code/appendix-D-Copy2.ipynb

* Delete ch03/01_main-chapter-code/ch03-Copy1.ipynb

* Delete appendix-D/01_main-chapter-code/appendix-D-Copy1.ipynb

* Update ch07.ipynb

* Update ch07.ipynb
 2024-11-07 20:12:59 -06:00
Sebastian Raschka
6a9bedc2ec Update bonus section formatting (#400) 2024-10-12 10:26:08 -05:00
Sebastian Raschka
7a9a17608d Add user interface to ch06 and ch07 (#366) 
* Add user interface to ch06 and ch07

* pep8

* fix url
 2024-09-21 20:33:00 -05:00
rasbt
79ba591fbc Clarify API usage limits in bonus content 2024-09-15 08:05:04 -05:00
Jinge Wang
0dbc203f66 Fix 2 typos in 04_preferene-tuning-with-dpo (#356) 2024-09-15 07:36:22 -05:00
rasbt
3b9592830d clarifications 2024-09-11 20:16:35 -05:00
rasbt
435f153dac update title 2024-09-10 21:43:32 -05:00
Sebastian Raschka
f6f9825098 reflection-tuning dataset generation (#349) 2024-09-10 21:42:12 -05:00
rasbt
ce80a192cd refresh figures 2024-08-27 08:26:40 +02:00
Sebastian Raschka
a82169290e Note about MPS in ch06 and ch07 (#325) 2024-08-19 08:11:33 -05:00
Sebastian Raschka
bb73efb5cf Consistency update in README.md 2024-08-13 07:33:10 -05:00
rasbt
7a5771932b note about logistic sigmoid 2024-08-06 19:48:30 -05:00
rasbt
9ef132bb64 note about logistic sigmoid 2024-08-06 19:48:06 -05:00
rasbt
2245f8d9c1 extend equation description 2024-08-06 19:46:50 -05:00
rasbt
a65e06ff99 add more explanations 2024-08-06 19:45:11 -05:00
rasbt
089901db26 small figure update 2024-08-05 17:57:16 -05:00
Daniel Kleine
dcdf04e3bd minor DPO fixes (#298) 
* fixed issues, updated .gitignore

* added closing paren

* fixed CEL spelling

* fixed more minor issues

* Update ch07/01_main-chapter-code/ch07.ipynb

* Update ch07/04_preference-tuning-with-dpo/dpo-from-scratch.ipynb

* Update ch07/04_preference-tuning-with-dpo/dpo-from-scratch.ipynb

* Update ch07/04_preference-tuning-with-dpo/dpo-from-scratch.ipynb

---------

Co-authored-by: Sebastian Raschka <mail@sebastianraschka.com>
 2024-08-05 08:40:46 -05:00
rasbt
6030071e3f update model path 2024-08-05 07:36:08 -05:00
rasbt
f302f5e8d5 improve latex rendering in dpo notebook 2024-08-04 09:19:59 -05:00
Sebastian Raschka
09dc080cf3 Direct Preference Optimization from scratch (#294) 2024-08-04 08:57:36 -05:00
rasbt
ce33e706ba Fix 8-billion-parameter spelling 2024-07-28 10:48:56 -05:00
Daniel Kleine
60752e3b3a fixed typos and formatting (#291) 2024-07-28 10:04:33 -05:00
rasbt
7eb3f941a4 update figure caption 2024-07-27 13:30:18 -05:00
rasbt
4a0a8cd9e4 formatting 2024-07-27 09:51:24 -05:00
Sebastian Raschka
2b7bd46a93 Generate preference dataset with Llama 3.1 70B (#289) 2024-07-27 09:44:04 -05:00
Sebastian Raschka
6dd8666d9c Test code in pytorch 2.4 (#285) 
* test code in pytorch 2.4

* update
 2024-07-24 21:53:41 -05:00
rasbt
5d8a0c22ab use utf-8 encoding in json 2024-07-22 07:01:54 -05:00
Sebastian Raschka
d0f3b034d8 Add download help message (#274) 2024-07-19 08:29:29 -05:00
rasbt
3195594680 explain extra padding token 2024-07-17 07:38:25 -05:00
Jeroen Van Goey
70cfced899 fix typos, add codespell pre-commit hook (#264) 
* fix typos, add codespell pre-commit hook

* Update .pre-commit-config.yaml

---------

Co-authored-by: Sebastian Raschka <mail@sebastianraschka.com>
 2024-07-16 07:07:04 -05:00
Sebastian Raschka
377c14c25e break long lines in ch07 (#263) 2024-07-13 07:26:23 -05:00
Sebastian Raschka
2ce1d16de0 show how to use the finetuned model 2024-07-09 06:43:26 -07:00
Daniel Kleine
87f47a281a fixed spelling typos (#258) 2024-07-03 07:47:33 -05:00
rasbt
2b379abf70 add spearman and kendall-tau analysis 2024-07-02 07:55:32 -05:00
Sebastian Raschka
2d8eacb0fa Fix links in summary sections (#254) 2024-06-29 07:51:31 -05:00
rasbt
5e24a042c1 add links to summary sections 2024-06-29 07:33:26 -05:00
Daniel Kleine
fb4e37ae15 fixed minor issues (#252) 
* fixed typo

* fixed var name in md text
 2024-06-29 06:38:25 -05:00
Sebastian Raschka
65d68097ee Use deterministic ollama settings (#250) 
* deterministic ollama settings

* add missing file
 2024-06-27 07:16:48 -05:00
Daniel Kleine
99058c3d07 minor fixes (#248) 
* removed duplicated numpy req

* labels to array

* autopep8 NBs
 2024-06-26 08:52:51 -05:00