yujunjun/LLMs-from-scratch
1
0
Fork 0
mirror of https://github.com/rasbt/LLMs-from-scratch.git synced 2025-08-28 18:40:01 +00:00
Code Issues Packages Projects Releases Wiki Activity
595 Commits 8 Branches 0 Tags
Commit Graph

53 Commits

Author SHA1 Message Date
rasbt
ee1d4730ba fixes bold font #267 2024-07-16 17:51:15 -05:00
Daniel Kleine
7e0dd7f765 minor: removed redundant imports (#260) 
* removed duplicated imports

* removed empty cell
 2024-07-05 15:33:19 -05:00
rasbt
bd216fdade update decode method 2024-07-05 08:34:27 -05:00
Suman Debnath
46f4d9e575 fixing the regular expression used in the SimpleTokenizer (#259) 
* fixing the regular expression used in the SimpleTokenizer class and a typo in the 2.7 Creating token embedding introduction section

* rerun

---------

Co-authored-by: rasbt <mail@sebastianraschka.com>
 2024-07-04 12:27:27 -05:00
rasbt
64536ca40f update figures 2024-07-02 17:12:42 -05:00
rasbt
5e24a042c1 add links to summary sections 2024-06-29 07:33:26 -05:00
Sebastian Raschka
4fef19e016 remove redundant code lines (#247) 2024-06-25 21:44:19 -05:00
rasbt
f46441d53f update with latest versions 2024-06-25 21:09:27 -05:00
Daniel Kleine
7a54d383e7 minor fixes (#246) 
* removed duplicated white spaces

* Update ch07/01_main-chapter-code/ch07.ipynb

* Update ch07/05_dataset-generation/llama3-ollama.ipynb

* removed duplicated white spaces

* fixed title again

---------

Co-authored-by: Sebastian Raschka <mail@sebastianraschka.com>
 2024-06-25 17:30:30 -05:00
Daniel Kleine
73be1c592f fixed num_workers (#229) 
* fixed num_workers

* ch06 & ch07: added num_workers to create_dataloader_v1
 2024-06-19 17:36:46 -05:00
Sebastian Raschka
40ba3a4068 Remove leftover instances of self.tokenizer (#201) 
* Remove leftover instances of self.tokenizer

* add endoftext token
 2024-06-08 14:57:34 -05:00
rasbt
20f1ef553c update figure 2.13 2024-06-01 09:38:33 -05:00
rasbt
fe8bb9291e update formatting 2024-05-24 07:20:37 -05:00
rasbt
1407085f07 reset cell count for better nbdiff 2024-05-22 20:27:09 -05:00
rasbt
85c3210105 update regex 2024-05-22 20:15:31 -05:00
rasbt
678fad50bc formatting for consistency with production chapter 2024-05-18 11:03:42 -05:00
rasbt
6c6321f671 simplify code 2024-05-16 20:16:25 -05:00
Sebastian Raschka
44a009f7e6 update stride wording 2024-04-22 20:40:48 -05:00
Sebastian Raschka
bae4b0fb08 Make datesets and loaders compatible with multiprocessing (#118) 2024-04-13 13:57:56 -05:00
Sebastian Raschka
bbce1cb143 Automated link checking (#117) 
* Automated link checking

* Fix links in Jupyter Nbs
 2024-04-12 19:08:34 -04:00
James Holcombe
0b866c133f Use instance tokenizer (#116) 
* Use instance tokenizer

* consistency updates

---------

Co-authored-by: Sebastian Raschka <mail@sebastianraschka.com>
 2024-04-10 21:16:19 -04:00
Sebastian Raschka
ccd7cebbb3 Rename variable to context_length to make it easier on readers (#106) 
* rename to context length

* fix spacing
 2024-04-04 07:27:41 -05:00
Intelligence-Manifesto
d081928e90 code -> markdown (#101) 2024-04-02 14:37:45 -05:00
rasbt
1c173e4f44 update figures 2024-03-30 09:43:51 -05:00
rasbt
ca96b7aee5 minor updates 2024-03-29 20:42:32 -05:00
Jeff Hammerbacher
5b222e2d6f Fix small typos in ch02.ipynb (#89) 2024-03-29 08:25:52 -05:00
rasbt
001507481e add colon and semicolon to tokenizer 2024-03-23 06:50:34 -05:00
Sebastian Raschka
a2cd8436cb Ch05 supplementary code (#81) 2024-03-19 09:26:26 -05:00
Intelligence-Manifesto
c49aa22738 three -> four 2024-03-17 23:40:44 +08:00
rasbt
d60da19fd0 add more notes and embed figures externally to save space 2024-03-17 09:08:38 -05:00
Xiangzhuang Shen
fa2864ddbf fix: inner links 2024-03-11 10:52:56 +08:00
rasbt
3beaea46ce add lowres figs for better navigation 2024-03-08 07:18:06 -06:00
rasbt
c5b17c3d67 simplify 2024-03-07 07:52:24 -06:00
rasbt
3198363c4f add wording from three to four 2024-03-04 06:42:58 -06:00
rasbt
29672da3b0 stride consistency 2024-03-03 19:37:06 -06:00
rasbt
cc2383c4de remove duplicated exercise code 2024-03-02 16:44:36 -06:00
rasbt
cdcd73ba7f drop_last=True 2024-02-25 07:23:38 -06:00
Intelligence-Manifesto
a61583e31e if -> in 
if -> in
 2024-02-09 04:18:07 +08:00
rasbt
16b30ccd5c set stride equal to max len 2024-02-03 08:50:56 -06:00
Intelligence-Manifesto
78ab68b4d3 missing single quotes 
missing single quotes
 2024-02-03 03:41:31 +08:00
Intelligence-Manifesto
004d6a2af9 a repetition of the word "by" 
"The Verdict by by Edith Wharton" contains a repetition of the word "by." The correct form should be "The Verdict by Edith Wharton."
 2024-01-26 00:43:57 +08:00
rasbt
f27c9e6135 rename create_dataloader to create_dataloader_v1 2024-01-24 07:02:05 -06:00
rasbt
8860e16e05 <|endoftext|> token in dataset v1 2024-01-21 12:03:04 -06:00
rasbt
92896d817c add toggle for qkv_bias 2024-01-17 07:50:57 -06:00
rasbt
f279134492 small cosmetic fixes and improvements 2024-01-10 08:01:19 -06:00
rasbt
ea4b6c4e5f add package versions to the top of the notebook 2024-01-01 19:41:18 +01:00
rasbt
4f161bd549 use block size variable in positional embedding layer 2023-12-28 19:05:06 +01:00
Pietro Monticone
1bebe21b91 Update ch02.ipynb 2023-12-17 16:01:43 +01:00
rasbt
d015b2ad08 link summary and exercises 2023-12-08 06:30:20 -06:00
rasbt
f26aa70ebd fix size of positional embedding layer 2023-10-23 20:20:12 -05:00