yujunjun/LLMs-from-scratch
1
0
Fork 0
mirror of https://github.com/rasbt/LLMs-from-scratch.git synced 2025-08-29 11:00:55 +00:00
Code Issues Packages Projects Releases Wiki Activity
490 Commits 8 Branches 0 Tags
Commit Graph

490 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
rasbt
51f4980a42 style checks 2024-04-24 07:48:51 -05:00
rasbt
d311bae25a add usage 2024-04-24 07:27:04 -05:00
rasbt
fb54b064c9 add more experiments 2024-04-24 07:23:11 -05:00
rasbt
b2cf956054 update requirements 2024-04-24 06:38:02 -05:00
rasbt
881075aeb0 rename folder 2024-04-23 21:02:57 -05:00
rasbt
379a8ab39c update figures in bonus notebook 2024-04-23 21:01:27 -05:00
Sebastian Raschka
f656ef996d Chapter 6 ablation studies (#127) 
* Chapter 6 ablation studies

* add table

* formatting

* formatting

* formatting
 2024-04-23 09:51:52 -05:00
Sebastian Raschka
44a009f7e6 update stride wording 2024-04-22 20:40:48 -05:00
rasbt
4abaa168ac fix merge conflict 2024-04-22 07:05:40 -05:00
rasbt
df4fc602d8 update numbering 2024-04-22 07:00:20 -05:00
rasbt
2dd7bf9cda file header 2024-04-22 06:53:38 -05:00
Sebastian Raschka
79d40c25bf remove requests dependency (#125) 2024-04-21 14:15:05 -05:00
rasbt
90fb214822 update figures 2024-04-20 11:42:03 -05:00
Sebastian Raschka
4557d5830e Return nan if val loader is empty (#124) 2024-04-20 08:02:30 -05:00
Sebastian Raschka
b5878a80ff Use dim=-1 for consistency (#122) 2024-04-18 05:56:23 -05:00
Sebastian Raschka
49f01d06d0 Calculate warmup steps as a fraction (#121) 2024-04-17 20:30:42 -05:00
Sebastian Raschka
fdcb8f99fa extend setup instructions (#120) 2024-04-15 21:05:03 -05:00
Sebastian Raschka
e5c567ad02 Update README.md 2024-04-14 12:42:02 -05:00
rasbt
6aa58ee2a9 shorten badge names 2024-04-14 12:41:23 -05:00
Sebastian Raschka
dc7bfde0e7 Check hyperlink badge 2024-04-14 12:38:55 -05:00
Sebastian Raschka
ef2de4718e use torch no grad for loss (#119) 2024-04-14 08:13:07 -05:00
Sebastian Raschka
98f1e97452 Update README.md 2024-04-13 15:04:08 -05:00
Sebastian Raschka
bae4b0fb08 Make datesets and loaders compatible with multiprocessing (#118) 2024-04-13 13:57:56 -05:00
Sebastian Raschka
8fe63a9a0e use correct lr 2024-04-12 19:55:07 -04:00
Sebastian Raschka
bbce1cb143 Automated link checking (#117) 
* Automated link checking

* Fix links in Jupyter Nbs
 2024-04-12 19:08:34 -04:00
Sebastian Raschka
d1a4157d71 improve check-links.yml 2024-04-11 17:23:15 -04:00
Sebastian Raschka
02f8b2ee26 unit test indicator placement 2024-04-10 22:15:07 -04:00
Sebastian Raschka
40539a2542 setup instruction note 2024-04-10 22:13:22 -04:00
Sebastian Raschka
790d0808b2 Organized setup instructions (#115) 
* Organized setup instructions

* update tets

* link checker action

* raise error upon broken link

* fix links

* fix links

* delete duplicated paragraph
 2024-04-10 22:09:46 -04:00
James Holcombe
0b866c133f Use instance tokenizer (#116) 
* Use instance tokenizer

* consistency updates

---------

Co-authored-by: Sebastian Raschka <mail@sebastianraschka.com>
 2024-04-10 21:16:19 -04:00
Sebastian Raschka
94f6582cff move devcontainer (#113) 2024-04-08 20:49:37 -04:00
Daniel Kleine
b01204ca3a Added PDF display support to Docker image and VS Code and updated first step for gutenberg project (#111) 
* added VS Code extensions recommendations

* Added PDF display support to Docker image and VS Code

* fixed steps to download the dataset
 2024-04-08 20:37:55 -04:00
rasbt
8462a777bd address suggestions to improve clarity 2024-04-07 08:41:09 -05:00
rasbt
040ce578be renumber exercises 2024-04-07 06:03:41 -05:00
Daniel Kleine
c76941e061 added VS Code extensions recommendations (#110) 2024-04-05 08:30:56 -05:00
rasbt
84b785ddd0 variable renaming for clarity 2024-04-05 07:26:42 -05:00
rasbt
c31e99720d rename hparams to settings 2024-04-05 07:24:46 -05:00
Daniel Kleine
7d0b9b78b0 Updated devcontainer, .gitignore and README for gutenberg project (#107) 
* added ch05/03_bonus_pretraining_on_gutenberg model checkpoints and preprocessing output folders to .gitignore

* removed prettier extension, added github alerts markdown extension

* specified download instructions and fixed code markdown

* Update ch05/03_bonus_pretraining_on_gutenberg/README.md

* Update ch05/03_bonus_pretraining_on_gutenberg/README.md

---------

Co-authored-by: Sebastian Raschka <mail@sebastianraschka.com>
 2024-04-05 06:53:01 -05:00
Sebastian Raschka
25f533efe0 Fix Loss in Gutenberg bonus section (#109) 2024-04-04 20:54:09 -05:00
rasbt
c8cffefb6f cleanup 2024-04-04 07:58:41 -05:00
Sebastian Raschka
ccd7cebbb3 Rename variable to context_length to make it easier on readers (#106) 
* rename to context length

* fix spacing
 2024-04-04 07:27:41 -05:00
Sebastian Raschka
684562733a Add rsync to dockerfile 2024-04-03 20:28:02 -05:00
Sebastian Raschka
5beff4e25a Remove reundant dropout in MLP module (#105) 2024-04-03 20:19:08 -05:00
rasbt
edcae09884 improve importlib experience for windows users 2024-04-03 06:31:15 -05:00
rasbt
cd12b4a937 rename batch to text 2024-04-02 20:46:53 -05:00
rasbt
21140b98d4 update notes 2024-04-02 18:27:13 -05:00
Intelligence-Manifesto
0b47dfc381 "Typographical error (#104) 2024-04-02 18:07:21 -05:00
Suman Debnath
ec4fe5377d fixing the README for python setup under appendix-A (#102) 
* fixing the README for python setup under appendix-A

* fixing the README for python setup under appendix-A
 2024-04-02 15:51:11 -05:00
Intelligence-Manifesto
d081928e90 code -> markdown (#101) 2024-04-02 14:37:45 -05:00
Sebastian Raschka
809c944d30 Use max size properly 2024-04-02 13:29:23 -05:00