yujunjun/LLMs-from-scratch
1
0
Fork 0
mirror of https://github.com/rasbt/LLMs-from-scratch.git synced 2025-11-04 03:40:21 +00:00
Code Issues Packages Projects Releases Wiki Activity
685 Commits 11 Branches 0 Tags
Commit Graph

93 Commits

Author SHA1 Message Date
Daniel Kleine
9674e62166 nbviewer links / typo (#346) 
* fixed typo

* removed remaining nbviewer links

* Update mha-implementations.ipynb

---------

Co-authored-by: Sebastian Raschka <mail@sebastianraschka.com>
 2024-09-07 07:27:28 +02:00
Sebastian Raschka
9bb203b1b7 Einsum multi-head attention (#345) 
* Einsum multi-head attention

* update diff
 2024-09-05 18:24:33 +02:00
Daniel Kleine
bf1d8687f4 added std error bars (#320) 
* added std error bars

* fixed changes

* Update on A100

---------

Co-authored-by: Sebastian Raschka <mail@sebastianraschka.com>
 2024-08-13 20:57:41 -05:00
Jeroen Van Goey
75abb61f13 Small typo fix (#313) 
* typo fix

* Update ch03/02_bonus_efficient-multihead-attention/mha-implementations.ipynb

* Update ch03/02_bonus_efficient-multihead-attention/mha-implementations.ipynb

* Update ch03/02_bonus_efficient-multihead-attention/mha-implementations.ipynb

---------

Co-authored-by: Sebastian Raschka <mail@sebastianraschka.com>
 2024-08-12 07:54:12 -05:00
Sebastian Raschka
f58c2b969b update attention benchmarks (#307) 2024-08-10 09:44:11 -05:00
Sebastian Raschka
6c2d34b03d Update README.md 2024-07-30 06:55:41 -05:00
rasbt
358717870b add state_dict example 2024-07-28 14:15:32 -05:00
Sebastian Raschka
1b86a61a2e buffer tutorial 2024-07-27 17:06:16 -05:00
rasbt
3da0f18da7 update 2024-07-27 07:12:42 -05:00
Sebastian Raschka
1e873d4cbc Understanding PyTorch Buffers (#288) 2024-07-26 08:45:36 -05:00
Sebastian Raschka
6dd8666d9c Test code in pytorch 2.4 (#285) 
* test code in pytorch 2.4

* update
 2024-07-24 21:53:41 -05:00
Jeroen Van Goey
70cfced899 fix typos, add codespell pre-commit hook (#264) 
* fix typos, add codespell pre-commit hook

* Update .pre-commit-config.yaml

---------

Co-authored-by: Sebastian Raschka <mail@sebastianraschka.com>
 2024-07-16 07:07:04 -05:00
rasbt
5e24a042c1 add links to summary sections 2024-06-29 07:33:26 -05:00
rasbt
01c4b8f645 add clarification about :num_tokens 2024-06-29 07:16:42 -05:00
rasbt
c1f9361428 add main and optional sections 2024-06-19 17:48:25 -05:00
rasbt
e2f0d936f8 update dotted line 2024-06-17 20:17:56 -05:00
rasbt
8fa64806fc dim-consistency 2024-06-12 19:43:25 -05:00
rasbt
b2ff989174 distinguish better between main chapter code and bonus materials 2024-06-11 21:07:42 -05:00
Sebastian Raschka
40ba3a4068 Remove leftover instances of self.tokenizer (#201) 
* Remove leftover instances of self.tokenizer

* add endoftext token
 2024-06-08 14:57:34 -05:00
Sebastian Raschka
98d23751f7 Explain value truncation in some figures (#199) 
* clarify truncation

* typo fix
 2024-06-08 13:24:37 -05:00
rasbt
a6113fcd33 clarify truncation 2024-06-08 13:13:43 -05:00
Sebastian Raschka
688df76bc0 Merge pull request #184 from rasbt/api-key-approach 
Change API key retrieval approach
 2024-05-27 08:47:04 -04:00
rasbt
c0f564ee87 update mha dim 2024-05-27 07:46:29 -05:00
rasbt
f86a929665 revert unnecessary changes 2024-05-27 07:37:06 -05:00
rasbt
134334ce21 Revert "Revert "newline"" 
This reverts commit 6aa2a587d22105910bd6f07c6c79a5abf83a5eb6.
 2024-05-27 07:32:45 -05:00
rasbt
6aa2a587d2 Revert "newline" 
This reverts commit 9eeeb67329f6ee0ee562a716586722bf00d68bb8.
 2024-05-27 07:32:22 -05:00
rasbt
9eeeb67329 newline 2024-05-27 07:30:27 -05:00
rasbt
ec6e09136a update pr 2024-05-26 15:38:35 -05:00
Kostyantyn Borysenko
18b5724e75 Fix an incorrect input dimension 2024-05-26 13:05:07 -07:00
rasbt
fe8bb9291e update formatting 2024-05-24 07:20:37 -05:00
rasbt
b8ba2c257a make consistent with the latest production version 2024-05-18 12:08:39 -05:00
Sebastian Raschka
5ae5e9df3b Try windows runners (#133) 
* try windows runners

* update triggers

* trigger with code file update

* add new status badges
 2024-04-28 07:39:23 -05:00
Sebastian Raschka
0528446584 Make code more consistent and add projection layer (#131) 
* Make code more consistent and add projection

* remove redundant buffer
 2024-04-26 17:13:08 -05:00
Sebastian Raschka
b5878a80ff Use dim=-1 for consistency (#122) 2024-04-18 05:56:23 -05:00
James Holcombe
0b866c133f Use instance tokenizer (#116) 
* Use instance tokenizer

* consistency updates

---------

Co-authored-by: Sebastian Raschka <mail@sebastianraschka.com>
 2024-04-10 21:16:19 -04:00
rasbt
c8cffefb6f cleanup 2024-04-04 07:58:41 -05:00
Sebastian Raschka
ccd7cebbb3 Rename variable to context_length to make it easier on readers (#106) 
* rename to context length

* fix spacing
 2024-04-04 07:27:41 -05:00
rasbt
21140b98d4 update notes 2024-04-02 18:27:13 -05:00
Intelligence-Manifesto
0b47dfc381 "Typographical error (#104) 2024-04-02 18:07:21 -05:00
rasbt
3ad442ee90 skip version cell 2024-03-28 08:23:33 -05:00
Sebastian Raschka
cf39abac04 Add and link bonus material (#84) 2024-03-23 07:27:43 -05:00
Sebastian Raschka
a2cd8436cb Ch05 supplementary code (#81) 2024-03-19 09:26:26 -05:00
Sebastian Raschka
ca96abac8a Set up basic test gh worklows (#79) 
* Set up basic test gh worklows

* update file paths

* env check

* add env check

* Update requirements.txt

* simplify

* upd
 2024-03-18 11:58:37 -05:00
Sebastian Raschka
9d6da22ebb Update pep8 (#78) 
* simplify requirements file

* style

* apply linter
 2024-03-18 08:16:17 -05:00
rasbt
4fc6de7afa add notes 2024-03-17 09:29:06 -05:00
rasbt
d60da19fd0 add more notes and embed figures externally to save space 2024-03-17 09:08:38 -05:00
Intelligence-Manifesto
d4b4e3d0f0 the above -> the following 2024-03-15 05:00:28 +08:00
rasbt
1870b4bacd update stride param 2024-03-13 08:39:59 -05:00
rasbt
0d517e98b9 update 2024-03-13 08:37:54 -05:00
rasbt
f2c8eeb6b8 pretraining on project gutenberg 2024-03-13 08:34:39 -05:00