yujunjun/LLMs-from-scratch
1
0
Fork 0
mirror of https://github.com/rasbt/LLMs-from-scratch.git synced 2025-08-09 09:12:51 +00:00
Code Issues Packages Projects Releases Wiki Activity
732 Commits 7 Branches 0 Tags
Commit Graph

732 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Sebastian Raschka
70e5714556
improve gradient accumulation (#300) 2024-08-05 18:27:20 -05:00
rasbt
36fbc7aa74
small figure update 2024-08-05 17:57:16 -05:00
Sebastian Raschka
50332cf75b
Update README.md 2024-08-05 17:47:06 -05:00
Daniel Kleine
8318d1f002
minor DPO fixes (#298) 
* fixed issues, updated .gitignore

* added closing paren

* fixed CEL spelling

* fixed more minor issues

* Update ch07/01_main-chapter-code/ch07.ipynb

* Update ch07/04_preference-tuning-with-dpo/dpo-from-scratch.ipynb

* Update ch07/04_preference-tuning-with-dpo/dpo-from-scratch.ipynb

* Update ch07/04_preference-tuning-with-dpo/dpo-from-scratch.ipynb

---------

Co-authored-by: Sebastian Raschka <mail@sebastianraschka.com>
 2024-08-05 08:40:46 -05:00
rasbt
36b9d5e0eb
update model path 2024-08-05 07:36:08 -05:00
SSebo
7643c6c0c4
Update ch05.ipynb (#297) 
typo
 2024-08-05 07:12:27 -05:00
Sebastian Raschka
16e83434b5
Update README.md 2024-08-04 16:06:38 -05:00
rasbt
60aada801b
improve latex rendering in dpo notebook 2024-08-04 09:19:59 -05:00
Sebastian Raschka
e130ca293c
Update matplotlib tests on Windows (#295) 2024-08-04 09:18:19 -05:00
Sebastian Raschka
52435804eb
Direct Preference Optimization from scratch (#294) 2024-08-04 08:57:36 -05:00
Sebastian Raschka
ff7a6db212
Update README.md 2024-08-01 18:17:42 -05:00
rasbt
b5fc1a6061
restructure into local and cloud setup 2024-07-31 06:59:04 -05:00
Sebastian Raschka
1b100179c0
Add video tutorial 2024-07-30 06:57:46 -05:00
Sebastian Raschka
f5a003744e
Update README.md 2024-07-30 06:55:41 -05:00
rasbt
0dad0a3c04
add state_dict example 2024-07-28 14:15:32 -05:00
rasbt
a7869ad2bf
Fix 8-billion-parameter spelling 2024-07-28 10:48:56 -05:00
Daniel Kleine
9a3b04f92f
fixed typos and formatting (#291) 2024-07-28 10:04:33 -05:00
Sebastian Raschka
9bf5d67d61
Update README.md 2024-07-28 09:28:11 -05:00
Sebastian Raschka
4f7f5bd443
Update README.md 2024-07-28 08:21:38 -05:00
Sebastian Raschka
f4fc0ededd
buffer tutorial 2024-07-27 17:06:16 -05:00
Sebastian Raschka
263eee8921
Test with PyTorch 2.0 and 2.4 (#290) 
* Test with PyTorch 2.0 and 2.4

* Update basic-tests-old-pytorch.yml

* skip version cell
 2024-07-27 15:09:02 -05:00
Sebastian Raschka
9a2a269530
Update README.md 2024-07-27 13:39:23 -05:00
rasbt
9eb2e2a5f6
update figure caption 2024-07-27 13:30:18 -05:00
rasbt
c87e4364b7
formatting 2024-07-27 09:51:24 -05:00
Sebastian Raschka
99af403b9f
Generate preference dataset with Llama 3.1 70B (#289) 2024-07-27 09:44:04 -05:00
rasbt
7f1e071fff
update 2024-07-27 07:12:42 -05:00
Sebastian Raschka
deea13e5c2
Understanding PyTorch Buffers (#288) 2024-07-26 08:45:36 -05:00
Sebastian Raschka
08040f024c
Test code in pytorch 2.4 (#285) 
* test code in pytorch 2.4

* update
 2024-07-24 21:53:41 -05:00
TITC
6cbe6520a2
47,678-->48,725 (#281) 2024-07-22 21:24:57 -05:00
rasbt
46fcde15d8
use utf-8 encoding in json 2024-07-22 07:01:54 -05:00
Sebastian Raschka
fa56c80402
Simplify embedding vs linear layer code (#278) 2024-07-21 12:21:10 -05:00
Sebastian Raschka
bbe09e9799
Update README.md 2024-07-21 10:42:28 -05:00
Sebastian Raschka
0d28079a8a
Update README.md 2024-07-21 10:41:53 -05:00
Sebastian Raschka
8d02cb1cee
Add download help message (#274) 2024-07-19 08:29:29 -05:00
Sebastian Raschka
eb6ca4311f
Updated test badges 2024-07-18 20:26:51 -05:00
rasbt
be14f06442
explain extra padding token 2024-07-17 07:38:25 -05:00
Thanh Tran
070a69fc8b
fix typos & inconsistent texts (#269) 
Co-authored-by: TRAN <you@example.com>
 2024-07-17 07:34:51 -05:00
rasbt
a33e89c12c
fixes bold font #267 2024-07-16 17:51:15 -05:00
Sebastian Raschka
45d0318ae6
Gh workflow for spelling errors (#265) 
* Gh workflow for spelling errors

* add files to check
 2024-07-16 08:17:20 -05:00
Jeroen Van Goey
48bd72c890
fix typos, add codespell pre-commit hook (#264) 
* fix typos, add codespell pre-commit hook

* Update .pre-commit-config.yaml

---------

Co-authored-by: Sebastian Raschka <mail@sebastianraschka.com>
 2024-07-16 07:07:04 -05:00
rasbt
6ffd628bb6
add missing "be" to figure 2024-07-15 08:06:05 -05:00
rasbt
7e632f90eb
clarify libraries 2024-07-14 08:53:16 -05:00
Sebastian Raschka
e0148f6ecc
break long lines in ch07 (#263) 2024-07-13 07:26:23 -05:00
Sebastian Raschka
17ff4c6328
Add download instructions 2024-07-13 06:31:14 -05:00
Sebastian Raschka
4f0a107692 show how to use the finetuned model 2024-07-09 06:43:26 -07:00
Sebastian Raschka
e2918af036
Update README.md 2024-07-06 08:26:50 -05:00
Daniel Kleine
88186bf64a
minor: removed redundant imports (#260) 
* removed duplicated imports

* removed empty cell
 2024-07-05 15:33:19 -05:00
rasbt
b92dea8bc6
update decode method 2024-07-05 08:34:27 -05:00
Suman Debnath
2cdcf68598
fixing the regular expression used in the SimpleTokenizer (#259) 
* fixing the regular expression used in the SimpleTokenizer class and a typo in the 2.7 Creating token embedding introduction section

* rerun

---------

Co-authored-by: rasbt <mail@sebastianraschka.com>
 2024-07-04 12:27:27 -05:00
Sebastian Raschka
b02ccb5f6f
Update README.md 2024-07-03 20:28:04 -05:00