Sebastian Raschka
48e98abc8e
add special token handling to bpe from scratch code ( #616 )
2025-04-13 12:38:22 -05:00
Sebastian Raschka
d5eaa36416
Ch06 and Ch07 videos ( #613 )
...
* Ch06 and Ch07 videos
* exclude google scholar from link checking
2025-04-12 14:51:02 -05:00
PRASHANTH REDDY NIMMAKAYALA
cff41c1fbc
fix: typo in ch07.ipynb ( #612 )
2025-04-12 10:29:53 -05:00
Sebastian Raschka
b662ec9ada
Improve ModernBERT comments ( #606 )
...
* Improve modernbert comments
* bash code formatting
2025-04-06 18:29:22 -05:00
Sebastian Raschka
9e08fff657
align formulas in notes with code ( #605 )
2025-04-06 16:46:53 -05:00
Sebastian Raschka
97a199e40b
Disable mask saving as weight in Llama 3 model ( #604 )
...
* Disable mask saving as weight
* update pixi
* update pixi
2025-04-06 09:33:36 -05:00
Sebastian Raschka
c43d7ef663
reformat nbs ( #602 )
2025-04-05 16:18:27 -05:00
Sebastian Raschka
ab17357474
Correct BERT experiments ( #600 )
2025-04-05 10:05:15 -05:00
Sebastian Raschka
14f976e024
Add ModernBERT ( #598 )
2025-04-05 09:13:30 -05:00
Sebastian Raschka
396e96ab07
Fix Llama language typo in bonus materials ( #597 )
2025-04-02 21:41:36 -05:00
Sebastian Raschka
f61baf86f2
Fix link ( #596 )
2025-04-02 09:47:07 -05:00
Sebastian Raschka
2dc2df593a
Llama3Fast ( #593 )
...
* Llama3Fast
* Update pkg/llms_from_scratch/tests/test_llama3.py
2025-04-01 12:56:11 -05:00
Sebastian Raschka
4128a91c1d
Add Llama 3.2 to pkg ( #591 )
...
* Add Llama 3.2 to pkg
* remove redundant attributes
* update tests
* updates
* updates
* updates
* fix link
* fix link
2025-03-31 18:59:47 -05:00
casinca
d7c316533a
removing unused RoPE parameters ( #590 )
...
* removing unused RoPE parameters
* remove redundant context_length in GQA
---------
Co-authored-by: Sebastian Raschka <mail@sebastianraschka.com>
2025-03-31 17:10:39 -05:00
Sebastian Raschka
d75f74bd0c
Fix data download if UCI is temporarily down ( #592 )
2025-03-31 16:25:53 -05:00
Sebastian Raschka
0bdcce4e40
Clarify dataset length in chapter 2 ( #589 )
2025-03-30 16:01:37 -05:00
Sebastian Raschka
4e3b752e5e
Memory optimized Llama ( #588 )
...
* Memory optimized Llama
* re-ad login
2025-03-30 15:18:12 -05:00
Sebastian Raschka
e55e3e88e1
Alt weight loading code via PyTorch ( #585 )
...
* Alt weight loading code via PyTorch
* commit additional files
2025-03-27 20:10:23 -05:00
Sebastian Raschka
e07a7abdd5
Add GPTModelFast ( #584 )
...
* Add GPTModelFast
* update
2025-03-27 14:00:25 -05:00
Sebastian Raschka
c9271ac427
Adjust comment to save compiled model ( #583 )
2025-03-27 10:43:45 -05:00
Daniel Kleine
d4d420361c
updated .gitignore ( #581 )
2025-03-26 13:21:14 -05:00
Sebastian Raschka
857acfcc12
Vocab padding clarification ( #582 )
...
* vocab padding clarification
* Update ch05/10_llm-training-speed/README.md
2025-03-26 13:19:55 -05:00
Sebastian Raschka
fee7d4bb05
More explicit torchrun usage doc ( #578 )
2025-03-24 12:01:03 -05:00
Sebastian Raschka
cf6fb73553
Add readme ( #577 )
2025-03-23 19:35:12 -05:00
Sebastian Raschka
7114ccd10d
Add PyPI package ( #576 )
...
* Add PyPI package
* fixes
* fixes
2025-03-23 19:28:49 -05:00
Sebastian Raschka
85f2bc0a58
Speed comparison figure ( #575 )
2025-03-21 11:29:49 -05:00
Sebastian Raschka
84591abd5f
add ch04 code along video ( #573 )
2025-03-17 11:20:55 -05:00
Sebastian Raschka
d21d821412
Add chapter 3 coding along video link ( #572 )
2025-03-16 16:07:14 -05:00
Sebastian Raschka
384b9ce959
Better instruction eva prompt ( #571 )
2025-03-15 17:13:15 -05:00
Greg Gandenberger
1ec5631c70
Fix minor printing issue and note inconsistency across platforms ( #563 )
...
* Fix printing issue and note inconsistency
* Rerun notebook
2025-03-14 15:12:09 -05:00
Sebastian Raschka
67244aba8a
Clarification about launching jupyter lab ( #565 )
...
* Clarification about launching jupyter lab
* fix juputer typo
2025-03-14 14:37:22 -05:00
Sebastian Raschka
634a531223
Cosmetic improvements to the BPE code ( #562 )
2025-03-09 10:49:40 -05:00
Sebastian Raschka
6aec412421
Fix BPE bonus materials ( #561 )
...
* Fix BPE bonus materials
* fix bpe implementation
* update
* Add 'Hello, world. Is this-- a test?' test case
* update link to test file
* update path handling
* update path handling
* fix pytest paths
2025-03-08 17:21:30 -06:00
Sebastian Raschka
faadd13871
Update mha plot ( #560 )
2025-03-06 20:29:04 -06:00
Sebastian Raschka
4fb0ea9d1f
Specify UTF-8 encoding in the json load command explicitely ( #557 )
2025-03-05 11:46:21 -06:00
Sebastian Raschka
de60da9a6b
Add a note about "zsh: illegal hardware instruction python" error ( #555 )
2025-03-02 15:18:24 -06:00
Sebastian Raschka
5be0e3cbbd
add link to supplementary ch02 video ( #553 )
2025-03-02 13:17:42 -06:00
Sebastian Raschka
839a7e9bfc
Use correct ch02 title ( #551 )
2025-02-28 10:16:21 -06:00
Sebastian Raschka
db58925d7f
Add BPE from scratch link ( #550 )
2025-02-28 09:57:41 -06:00
Greg Gandenberger
80c95987c1
Add note about context_length ( #549 )
...
* Add note about context_length
* update note
---------
Co-authored-by: rasbt <mail@sebastianraschka.com>
2025-02-27 08:36:41 -06:00
Sebastian Raschka
b6f9c8956f
Add setup video tutorial ( #547 )
...
* Add setup video tutorial
* updated link checks
* updated link checks
2025-02-26 13:53:22 -06:00
Sebastian Raschka
f5a296d8e7
Consitent spacing ( #546 )
2025-02-23 17:52:00 -06:00
Sebastian Raschka
fa5760a8de
GitHub markdown updates ( #545 )
...
* GitHub markdown updates
* Apply suggestions from code review
* Apply suggestions from code review
2025-02-23 12:25:44 -06:00
Sebastian Raschka
11801be0e9
Simplify the setup in CI ( #542 )
...
* Simplify the setup in CI
* windows --no-binary option
* windows uv workflow
* add path
* some fixes
* some fixes
* some fixes
* cleanup
* cleanup
* cleanup
* cleanup
* cleanup
* more windows issues
* more windows issues
* more windows issues
* more windows issues
* more windows issues
* more windows issues
* more windows issues
* more windows issues
* revert
2025-02-20 11:56:52 -06:00
Sebastian Raschka
4fad4695f6
Fix timeout issue related to spam data backup url ( #544 )
...
* Add backup url for Spam Dataset
* import urllib
* fix url
* fix timeout issue
2025-02-20 09:26:23 -06:00
Sebastian Raschka
eb6787397c
Add backup url for Spam Dataset ( #543 )
...
* Add backup url for Spam Dataset
* import urllib
* fix url
2025-02-20 08:08:28 -06:00
Tim Hopper
2254102270
Don't explicitly install Python. Use uv sync instead of uv add. ( #540 )
...
* Don't explicitly install Python. Use uv sync instead of uv add.
* updates
* update
* updated 3.11 workflows
---------
Co-authored-by: rasbt <mail@sebastianraschka.com>
2025-02-19 10:42:13 -06:00
Kasen
af4b73ca7b
Improve BPE vocabulary saving and pair frequency handling ( #539 )
2025-02-19 09:51:04 -06:00
Daniel Kleine
58aabe7dd8
added uv to Dockerfile ( #537 )
...
* added uv to Dockerfile
* Update Dockerfile
---------
Co-authored-by: Sebastian Raschka <mail@sebastianraschka.com>
2025-02-18 14:53:19 -06:00
Kasen
0a5214b804
Fix incorrect indentation ( #536 )
2025-02-18 14:47:31 -06:00
