Sebastian Raschka
c43d7ef663
reformat nbs ( #602 )
2025-04-05 16:18:27 -05:00
Sebastian Raschka
ab17357474
Correct BERT experiments ( #600 )
2025-04-05 10:05:15 -05:00
Sebastian Raschka
14f976e024
Add ModernBERT ( #598 )
2025-04-05 09:13:30 -05:00
Sebastian Raschka
396e96ab07
Fix Llama language typo in bonus materials ( #597 )
2025-04-02 21:41:36 -05:00
Sebastian Raschka
f61baf86f2
Fix link ( #596 )
2025-04-02 09:47:07 -05:00
Sebastian Raschka
2dc2df593a
Llama3Fast ( #593 )
...
* Llama3Fast
* Update pkg/llms_from_scratch/tests/test_llama3.py
2025-04-01 12:56:11 -05:00
Sebastian Raschka
4128a91c1d
Add Llama 3.2 to pkg ( #591 )
...
* Add Llama 3.2 to pkg
* remove redundant attributes
* update tests
* updates
* updates
* updates
* fix link
* fix link
2025-03-31 18:59:47 -05:00
casinca
d7c316533a
removing unused RoPE parameters ( #590 )
...
* removing unused RoPE parameters
* remove redundant context_length in GQA
---------
Co-authored-by: Sebastian Raschka <mail@sebastianraschka.com>
2025-03-31 17:10:39 -05:00
Sebastian Raschka
d75f74bd0c
Fix data download if UCI is temporarily down ( #592 )
2025-03-31 16:25:53 -05:00
Sebastian Raschka
0bdcce4e40
Clarify dataset length in chapter 2 ( #589 )
2025-03-30 16:01:37 -05:00
Sebastian Raschka
4e3b752e5e
Memory optimized Llama ( #588 )
...
* Memory optimized Llama
* re-ad login
2025-03-30 15:18:12 -05:00
Sebastian Raschka
e55e3e88e1
Alt weight loading code via PyTorch ( #585 )
...
* Alt weight loading code via PyTorch
* commit additional files
2025-03-27 20:10:23 -05:00
Sebastian Raschka
e07a7abdd5
Add GPTModelFast ( #584 )
...
* Add GPTModelFast
* update
2025-03-27 14:00:25 -05:00
Sebastian Raschka
c9271ac427
Adjust comment to save compiled model ( #583 )
2025-03-27 10:43:45 -05:00
Daniel Kleine
d4d420361c
updated .gitignore ( #581 )
2025-03-26 13:21:14 -05:00
Sebastian Raschka
857acfcc12
Vocab padding clarification ( #582 )
...
* vocab padding clarification
* Update ch05/10_llm-training-speed/README.md
2025-03-26 13:19:55 -05:00
Sebastian Raschka
fee7d4bb05
More explicit torchrun usage doc ( #578 )
2025-03-24 12:01:03 -05:00
Sebastian Raschka
cf6fb73553
Add readme ( #577 )
2025-03-23 19:35:12 -05:00
Sebastian Raschka
7114ccd10d
Add PyPI package ( #576 )
...
* Add PyPI package
* fixes
* fixes
2025-03-23 19:28:49 -05:00
Sebastian Raschka
85f2bc0a58
Speed comparison figure ( #575 )
2025-03-21 11:29:49 -05:00
Sebastian Raschka
84591abd5f
add ch04 code along video ( #573 )
2025-03-17 11:20:55 -05:00
Sebastian Raschka
d21d821412
Add chapter 3 coding along video link ( #572 )
2025-03-16 16:07:14 -05:00
Sebastian Raschka
384b9ce959
Better instruction eva prompt ( #571 )
2025-03-15 17:13:15 -05:00
Greg Gandenberger
1ec5631c70
Fix minor printing issue and note inconsistency across platforms ( #563 )
...
* Fix printing issue and note inconsistency
* Rerun notebook
2025-03-14 15:12:09 -05:00
Sebastian Raschka
67244aba8a
Clarification about launching jupyter lab ( #565 )
...
* Clarification about launching jupyter lab
* fix juputer typo
2025-03-14 14:37:22 -05:00
Sebastian Raschka
634a531223
Cosmetic improvements to the BPE code ( #562 )
2025-03-09 10:49:40 -05:00
Sebastian Raschka
6aec412421
Fix BPE bonus materials ( #561 )
...
* Fix BPE bonus materials
* fix bpe implementation
* update
* Add 'Hello, world. Is this-- a test?' test case
* update link to test file
* update path handling
* update path handling
* fix pytest paths
2025-03-08 17:21:30 -06:00
Sebastian Raschka
faadd13871
Update mha plot ( #560 )
2025-03-06 20:29:04 -06:00
Sebastian Raschka
4fb0ea9d1f
Specify UTF-8 encoding in the json load command explicitely ( #557 )
2025-03-05 11:46:21 -06:00
Sebastian Raschka
de60da9a6b
Add a note about "zsh: illegal hardware instruction python" error ( #555 )
2025-03-02 15:18:24 -06:00
Sebastian Raschka
5be0e3cbbd
add link to supplementary ch02 video ( #553 )
2025-03-02 13:17:42 -06:00
Sebastian Raschka
839a7e9bfc
Use correct ch02 title ( #551 )
2025-02-28 10:16:21 -06:00
Sebastian Raschka
db58925d7f
Add BPE from scratch link ( #550 )
2025-02-28 09:57:41 -06:00
Greg Gandenberger
80c95987c1
Add note about context_length ( #549 )
...
* Add note about context_length
* update note
---------
Co-authored-by: rasbt <mail@sebastianraschka.com>
2025-02-27 08:36:41 -06:00
Sebastian Raschka
b6f9c8956f
Add setup video tutorial ( #547 )
...
* Add setup video tutorial
* updated link checks
* updated link checks
2025-02-26 13:53:22 -06:00
Sebastian Raschka
f5a296d8e7
Consitent spacing ( #546 )
2025-02-23 17:52:00 -06:00
Sebastian Raschka
fa5760a8de
GitHub markdown updates ( #545 )
...
* GitHub markdown updates
* Apply suggestions from code review
* Apply suggestions from code review
2025-02-23 12:25:44 -06:00
Sebastian Raschka
11801be0e9
Simplify the setup in CI ( #542 )
...
* Simplify the setup in CI
* windows --no-binary option
* windows uv workflow
* add path
* some fixes
* some fixes
* some fixes
* cleanup
* cleanup
* cleanup
* cleanup
* cleanup
* more windows issues
* more windows issues
* more windows issues
* more windows issues
* more windows issues
* more windows issues
* more windows issues
* more windows issues
* revert
2025-02-20 11:56:52 -06:00
Sebastian Raschka
4fad4695f6
Fix timeout issue related to spam data backup url ( #544 )
...
* Add backup url for Spam Dataset
* import urllib
* fix url
* fix timeout issue
2025-02-20 09:26:23 -06:00
Sebastian Raschka
eb6787397c
Add backup url for Spam Dataset ( #543 )
...
* Add backup url for Spam Dataset
* import urllib
* fix url
2025-02-20 08:08:28 -06:00
Tim Hopper
2254102270
Don't explicitly install Python. Use uv sync instead of uv add. ( #540 )
...
* Don't explicitly install Python. Use uv sync instead of uv add.
* updates
* update
* updated 3.11 workflows
---------
Co-authored-by: rasbt <mail@sebastianraschka.com>
2025-02-19 10:42:13 -06:00
Kasen
af4b73ca7b
Improve BPE vocabulary saving and pair frequency handling ( #539 )
2025-02-19 09:51:04 -06:00
Daniel Kleine
58aabe7dd8
added uv to Dockerfile ( #537 )
...
* added uv to Dockerfile
* Update Dockerfile
---------
Co-authored-by: Sebastian Raschka <mail@sebastianraschka.com>
2025-02-18 14:53:19 -06:00
Kasen
0a5214b804
Fix incorrect indentation ( #536 )
2025-02-18 14:47:31 -06:00
Sebastian Raschka
18dd8ab633
Badge url updates
2025-02-17 12:07:47 -06:00
rasbt
acb1018917
update badges
2025-02-17 12:02:06 -06:00
rasbt
47030fd8c1
update badges
2025-02-17 12:00:46 -06:00
rasbt
1d1ac0b9a2
update readme badges
2025-02-17 11:49:41 -06:00
Matthew Feickert
bd0484c1be
feat: Add pixi environment ( #534 )
...
* feat: Add pixi environment
* Add pixi manifest pixi.toml for Linux x86, macOS arm64, Windows 64.
* ci: Update CI workflow and unify to one
* Enable workflow dispatch.
* Add concurrency limits.
* Use pixi for CI workflow.
* Unify to a single workflow for all OS tested
* feat: Add pixi lock file
* Ensure tensorflow-cpu installed on Windows
* fix package check
* fix package check
* simplification plus uv and pip runners
* some fixes to pixi and pip
* create pixi.lock
* fix pixi.lock issue
* another attempt trying to fix get_packages
* another attempt trying to fix get_packages
* clean up python_environment_check.py
* updated runner and docs
* use bash
* proper env activiation
* proper env activiation
---------
Co-authored-by: rasbt <mail@sebastianraschka.com>
2025-02-17 11:33:53 -06:00
Sebastian Raschka
15592c1204
note about google colab ( #535 )
2025-02-16 21:12:36 -06:00
