Sebastian Raschka
4a9654173c
Add ModernBERT ( #598 )
2025-04-05 09:13:30 -05:00
Sebastian Raschka
d4c8d8f2c9
Fix Llama language typo in bonus materials ( #597 )
2025-04-02 21:41:36 -05:00
Sebastian Raschka
49330d0990
Fix link ( #596 )
2025-04-02 09:47:07 -05:00
Sebastian Raschka
43e25a5165
Llama3Fast ( #593 )
...
* Llama3Fast
* Update pkg/llms_from_scratch/tests/test_llama3.py
2025-04-01 12:56:11 -05:00
Sebastian Raschka
aedad7efc3
Add Llama 3.2 to pkg ( #591 )
...
* Add Llama 3.2 to pkg
* remove redundant attributes
* update tests
* updates
* updates
* updates
* fix link
* fix link
2025-03-31 18:59:47 -05:00
casinca
152a087a37
removing unused RoPE parameters ( #590 )
...
* removing unused RoPE parameters
* remove redundant context_length in GQA
---------
Co-authored-by: Sebastian Raschka <mail@sebastianraschka.com>
2025-03-31 17:10:39 -05:00
Sebastian Raschka
222803737d
Fix data download if UCI is temporarily down ( #592 )
2025-03-31 16:25:53 -05:00
Sebastian Raschka
6ea4dd3ae7
Clarify dataset length in chapter 2 ( #589 )
2025-03-30 16:01:37 -05:00
Sebastian Raschka
0f6894f41e
Memory optimized Llama ( #588 )
...
* Memory optimized Llama
* re-ad login
2025-03-30 15:18:12 -05:00
Sebastian Raschka
3f93d73d6d
Alt weight loading code via PyTorch ( #585 )
...
* Alt weight loading code via PyTorch
* commit additional files
2025-03-27 20:10:23 -05:00
Sebastian Raschka
ffd4035144
Add GPTModelFast ( #584 )
...
* Add GPTModelFast
* update
2025-03-27 14:00:25 -05:00
Sebastian Raschka
2e143f17b8
Adjust comment to save compiled model ( #583 )
2025-03-27 10:43:45 -05:00
Daniel Kleine
f01e163aad
updated .gitignore ( #581 )
2025-03-26 13:21:14 -05:00
Sebastian Raschka
92f1313e00
Vocab padding clarification ( #582 )
...
* vocab padding clarification
* Update ch05/10_llm-training-speed/README.md
2025-03-26 13:19:55 -05:00
Sebastian Raschka
b7893457da
More explicit torchrun usage doc ( #578 )
2025-03-24 12:01:03 -05:00
Sebastian Raschka
feb1e9a83d
Add readme ( #577 )
2025-03-23 19:35:12 -05:00
Sebastian Raschka
c21bfe4a23
Add PyPI package ( #576 )
...
* Add PyPI package
* fixes
* fixes
2025-03-23 19:28:49 -05:00
Sebastian Raschka
7757c3d308
Speed comparison figure ( #575 )
2025-03-21 11:29:49 -05:00
Sebastian Raschka
73f4342664
add ch04 code along video ( #573 )
2025-03-17 11:20:55 -05:00
Sebastian Raschka
4db0e826b7
Add chapter 3 coding along video link ( #572 )
2025-03-16 16:07:14 -05:00
Sebastian Raschka
54474fb452
Better instruction eva prompt ( #571 )
2025-03-15 17:13:15 -05:00
Greg Gandenberger
c1611d4ea8
Fix minor printing issue and note inconsistency across platforms ( #563 )
...
* Fix printing issue and note inconsistency
* Rerun notebook
2025-03-14 15:12:09 -05:00
Sebastian Raschka
8d01d3b0c1
Clarification about launching jupyter lab ( #565 )
...
* Clarification about launching jupyter lab
* fix juputer typo
2025-03-14 14:37:22 -05:00
Sebastian Raschka
2f41429cf4
Cosmetic improvements to the BPE code ( #562 )
2025-03-09 10:49:40 -05:00
Sebastian Raschka
f63f04d8d5
Fix BPE bonus materials ( #561 )
...
* Fix BPE bonus materials
* fix bpe implementation
* update
* Add 'Hello, world. Is this-- a test?' test case
* update link to test file
* update path handling
* update path handling
* fix pytest paths
2025-03-08 17:21:30 -06:00
Sebastian Raschka
96ca2fcb2f
Update mha plot ( #560 )
2025-03-06 20:29:04 -06:00
Sebastian Raschka
86b714a5e0
Specify UTF-8 encoding in the json load command explicitely ( #557 )
2025-03-05 11:46:21 -06:00
Sebastian Raschka
5fc78ff9fd
Add a note about "zsh: illegal hardware instruction python" error ( #555 )
2025-03-02 15:18:24 -06:00
Sebastian Raschka
e9ad6cf86d
add link to supplementary ch02 video ( #553 )
2025-03-02 13:17:42 -06:00
Sebastian Raschka
e7740b3312
Use correct ch02 title ( #551 )
2025-02-28 10:16:21 -06:00
Sebastian Raschka
b1773897d3
Add BPE from scratch link ( #550 )
2025-02-28 09:57:41 -06:00
Greg Gandenberger
b92c0dff89
Add note about context_length ( #549 )
...
* Add note about context_length
* update note
---------
Co-authored-by: rasbt <mail@sebastianraschka.com>
2025-02-27 08:36:41 -06:00
Sebastian Raschka
8939fdc846
Add setup video tutorial ( #547 )
...
* Add setup video tutorial
* updated link checks
* updated link checks
2025-02-26 13:53:22 -06:00
Sebastian Raschka
cd5cf8112b
Consitent spacing ( #546 )
2025-02-23 17:52:00 -06:00
Sebastian Raschka
f12b899d96
GitHub markdown updates ( #545 )
...
* GitHub markdown updates
* Apply suggestions from code review
* Apply suggestions from code review
2025-02-23 12:25:44 -06:00
Sebastian Raschka
bca82a9443
Simplify the setup in CI ( #542 )
...
* Simplify the setup in CI
* windows --no-binary option
* windows uv workflow
* add path
* some fixes
* some fixes
* some fixes
* cleanup
* cleanup
* cleanup
* cleanup
* cleanup
* more windows issues
* more windows issues
* more windows issues
* more windows issues
* more windows issues
* more windows issues
* more windows issues
* more windows issues
* revert
2025-02-20 11:56:52 -06:00
Sebastian Raschka
d1e99f6092
Fix timeout issue related to spam data backup url ( #544 )
...
* Add backup url for Spam Dataset
* import urllib
* fix url
* fix timeout issue
2025-02-20 09:26:23 -06:00
Sebastian Raschka
c39aa32ef5
Add backup url for Spam Dataset ( #543 )
...
* Add backup url for Spam Dataset
* import urllib
* fix url
2025-02-20 08:08:28 -06:00
Tim Hopper
1039bf9b80
Don't explicitly install Python. Use uv sync instead of uv add. ( #540 )
...
* Don't explicitly install Python. Use uv sync instead of uv add.
* updates
* update
* updated 3.11 workflows
---------
Co-authored-by: rasbt <mail@sebastianraschka.com>
2025-02-19 10:42:13 -06:00
Kasen
7bd36dccb4
Improve BPE vocabulary saving and pair frequency handling ( #539 )
2025-02-19 09:51:04 -06:00
Daniel Kleine
3098b4f889
added uv to Dockerfile ( #537 )
...
* added uv to Dockerfile
* Update Dockerfile
---------
Co-authored-by: Sebastian Raschka <mail@sebastianraschka.com>
2025-02-18 14:53:19 -06:00
Kasen
b47884ced0
Fix incorrect indentation ( #536 )
2025-02-18 14:47:31 -06:00
Sebastian Raschka
67c226bf67
Badge url updates
2025-02-17 12:07:47 -06:00
rasbt
9ccecd13ae
update badges
2025-02-17 12:02:06 -06:00
rasbt
24f78865df
update badges
2025-02-17 12:00:46 -06:00
rasbt
2f67cbca0b
update readme badges
2025-02-17 11:49:41 -06:00
Matthew Feickert
a8b8eb4731
feat: Add pixi environment ( #534 )
...
* feat: Add pixi environment
* Add pixi manifest pixi.toml for Linux x86, macOS arm64, Windows 64.
* ci: Update CI workflow and unify to one
* Enable workflow dispatch.
* Add concurrency limits.
* Use pixi for CI workflow.
* Unify to a single workflow for all OS tested
* feat: Add pixi lock file
* Ensure tensorflow-cpu installed on Windows
* fix package check
* fix package check
* simplification plus uv and pip runners
* some fixes to pixi and pip
* create pixi.lock
* fix pixi.lock issue
* another attempt trying to fix get_packages
* another attempt trying to fix get_packages
* clean up python_environment_check.py
* updated runner and docs
* use bash
* proper env activiation
* proper env activiation
---------
Co-authored-by: rasbt <mail@sebastianraschka.com>
2025-02-17 11:33:53 -06:00
Sebastian Raschka
16738b61fd
note about google colab ( #535 )
2025-02-16 21:12:36 -06:00
Sebastian Raschka
bacb7aa90c
Update README.md
2025-02-16 13:37:32 -06:00
ridhachahed
03d72e6eb5
Fixing small typo in package description of the pyproject.toml file ( #533 )
...
Co-authored-by: Sebastian Raschka <mail@sebastianraschka.com>
2025-02-16 13:19:26 -06:00
