Sebastian Raschka
18dd8ab633
Badge url updates
2025-02-17 12:07:47 -06:00
rasbt
acb1018917
update badges
2025-02-17 12:02:06 -06:00
rasbt
47030fd8c1
update badges
2025-02-17 12:00:46 -06:00
rasbt
1d1ac0b9a2
update readme badges
2025-02-17 11:49:41 -06:00
Matthew Feickert
bd0484c1be
feat: Add pixi environment ( #534 )
...
* feat: Add pixi environment
* Add pixi manifest pixi.toml for Linux x86, macOS arm64, Windows 64.
* ci: Update CI workflow and unify to one
* Enable workflow dispatch.
* Add concurrency limits.
* Use pixi for CI workflow.
* Unify to a single workflow for all OS tested
* feat: Add pixi lock file
* Ensure tensorflow-cpu installed on Windows
* fix package check
* fix package check
* simplification plus uv and pip runners
* some fixes to pixi and pip
* create pixi.lock
* fix pixi.lock issue
* another attempt trying to fix get_packages
* another attempt trying to fix get_packages
* clean up python_environment_check.py
* updated runner and docs
* use bash
* proper env activiation
* proper env activiation
---------
Co-authored-by: rasbt <mail@sebastianraschka.com>
2025-02-17 11:33:53 -06:00
Sebastian Raschka
15592c1204
note about google colab ( #535 )
2025-02-16 21:12:36 -06:00
Sebastian Raschka
4d5f37abd4
Update README.md
2025-02-16 13:37:32 -06:00
ridhachahed
5c8d42ec8d
Fixing small typo in package description of the pyproject.toml file ( #533 )
...
Co-authored-by: Sebastian Raschka <mail@sebastianraschka.com>
2025-02-16 13:19:26 -06:00
Sebastian Raschka
5016499d1d
Uv workflow improvements ( #531 )
...
* Uv workflow improvements
* Uv workflow improvements
* linter improvements
* pytproject.toml fixes
* pytproject.toml fixes
* pytproject.toml fixes
* pytproject.toml fixes
* pytproject.toml fixes
* pytproject.toml fixes
* windows fixes
* windows fixes
* windows fixes
* windows fixes
* windows fixes
* windows fixes
* win32 fix
* win32 fix
* win32 fix
* win32 fix
* win32 fix
* win32 fix
* win32 fix
* win32 fix
* win32 fix
* win32 fix
* win32 fix
* win32 fix
* win32 fix
* win32 fix
* win32 fix
* win32 fix
* win32 fix
* win32 fix
* win32 fix
2025-02-16 13:16:51 -06:00
rasbt
2f0afedaa7
reduce redundancies
2025-02-15 21:31:22 -06:00
Sebastian Raschka
0d1f8c2bad
Add performance comparison
2025-02-15 21:16:36 -06:00
rasbt
2968af0559
formatting
2025-02-15 21:05:58 -06:00
rasbt
723d08cb9d
cosmetics
2025-02-15 20:53:26 -06:00
Sebastian Raschka
aa60bb3cd5
Native uv docs ( #530 )
...
* Replace pip by more modern uv
* uv tests
* Native uv docs
* resolve merge conflicts
* resolve merge conflicts
2025-02-15 20:35:23 -06:00
Sebastian Raschka
fac61004b0
Update README.md
2025-02-15 13:17:43 -06:00
Sebastian Raschka
4ab8719e9d
Switch from pip to uv ( #529 )
...
* Replace pip by more modern uv
* uv tests
* update yaml
* update yaml
* update yaml
* update flake8
* update windows commands
* fix windows test
* windows fix
* windows fix
* windows fix
* windows fix
* windows fix
* windows fix
* windows fix
* windows fix
* windows fix
* windows fix
2025-02-15 13:13:13 -06:00
Sebastian Raschka
e818be42e1
Update link to vocab size increase ( #526 )
...
* Update link to vocab size increase
* Update ch05/10_llm-training-speed/README.md
* Update ch05/10_llm-training-speed/README.md
2025-02-14 08:03:01 -06:00
Sebastian Raschka
6370898ce6
PyTorch tips for better training performance ( #525 )
...
* PyTorch tips for better training performance
* formatting
* pep 8
2025-02-12 16:10:34 -06:00
Sebastian Raschka
d16863c7db
Add torchrun bonus code ( #524 )
2025-02-11 17:01:09 -06:00
Victor Skvortsov
83b47adf0d
Comment that DDP-script.py does not work with GPUs > 2 ( #523 )
2025-02-11 13:23:49 -06:00
Sebastian Raschka
9dce43ec31
Upgrade to NumPy 2.0 ( #520 )
...
* Upgrade to NumPy 2.0
* bump pytorch
* bump pytorch
* bump pytorch
* bump pytorch
* bump pytorch
* update
* update packages
2025-02-09 06:21:58 -06:00
Sebastian Raschka
5efa731c0f
Mention small discrepancy due to Dropout non-reproducibility in PyTorch ( #519 )
...
* Mention small discrepancy due to Dropout non-reproducibility in PyTorch
* bump pytorch version
2025-02-06 14:59:52 -06:00
Daniel Kleine
b3e0458fa6
fixed indention and enumeration for nvct ( #518 )
2025-02-06 08:17:12 -06:00
Sebastian Raschka
d684ff418a
Fix typo in Ch02 comments ( #516 )
2025-02-04 20:16:07 -06:00
Sebastian Raschka
7e2092dd01
More pythonic way to find the longest sequence ( #512 )
...
* More pythonic way to find the longest sequence
* pep8 fix
2025-02-01 10:22:47 -06:00
Sebastian Raschka
c1c10c89c8
Test PyTorch nightly releases ( #509 )
2025-01-30 12:45:48 -06:00
Sebastian Raschka
fd24a3679a
Alternative weight loading via .safetensors ( #507 )
2025-01-29 08:15:29 -06:00
Sebastian Raschka
ebfc50f076
Fix default argument in ex 7.2 ( #506 )
2025-01-25 10:46:48 -06:00
Sebastian Raschka
d387696f93
A few cosmetic updates ( #504 )
2025-01-23 09:38:55 -06:00
Sebastian Raschka
bb13ff519e
Test for PyTorch 2.6 release candidate ( #500 )
...
* Test for PyTorch 2.6 release candidate
* update
* update
* remove extra added file
2025-01-22 18:37:48 -06:00
Sebastian Raschka
dcaac28b92
Bonus material: extending tokenizers ( #496 )
...
* Bonus material: extending tokenizers
* small wording update
2025-01-22 09:26:54 -06:00
Daniel Kleine
9175590ea4
add GPT2TokenizerFast to BPE comparison ( #498 )
...
* added HF BPE Fast
* update benchmarks
* add note about performance
* revert accidental changes
---------
Co-authored-by: rasbt <mail@sebastianraschka.com>
2025-01-22 09:26:44 -06:00
Austin Welch
654734053a
fix: preserve newline tokens in BPE encoder ( #495 )
...
* fix: preserve newline tokens in BPE encoder
* further fixes
* more fixes
---------
Co-authored-by: rasbt <mail@sebastianraschka.com>
2025-01-21 12:47:15 -06:00
Daniel Kleine
3f9facbc55
BPE: fixed typo ( #492 )
...
* fixed typo
* use rel path if exists
* mod gitignore and use existing vocab files
---------
Co-authored-by: rasbt <mail@sebastianraschka.com>
2025-01-20 20:49:53 -06:00
Sebastian Raschka
b17d097742
Implementingthe BPE Tokenizer from Scratch ( #487 )
2025-01-17 12:22:00 -06:00
rvaneijk
f936ad4b4e
04_optional-aws-sagemaker-notebook ( #451 )
...
* 04_optional-aws-sagemaker-notebook
* Update setup/04_optional-aws-sagemaker-notebook/cloudformation-template.yml
* Update README.md
---------
Co-authored-by: Sebastian Raschka <mail@sebastianraschka.com>
2025-01-17 10:07:10 -06:00
Sebastian Raschka
37aed8fc2c
Include mathematical breakdown for exercise solution 4.1 ( #483 )
2025-01-14 19:23:00 -06:00
Henry Shi
15af754304
Print out embeddings for more illustrative learning ( #481 )
...
* print out embeddings for illustrative learning
* suggestion print embeddingcontents
---------
Co-authored-by: rasbt <mail@sebastianraschka.com>
2025-01-13 14:44:06 -06:00
rasbt
bed5f89378
fix reward margins plot label in dpo nb
2025-01-12 14:04:05 -06:00
Sebastian Raschka
992f3068d1
Auto download DPO dataset if not already available in path ( #479 )
...
* Auto download DPO dataset if not already available in path
* update tests to account for latest HF transformers release in unit tests
* pep 8
2025-01-12 12:27:28 -06:00
Sebastian Raschka
05f2a398b8
adds no-grad context for reference model to DPO ( #473 )
2025-01-07 20:49:01 -06:00
Sebastian Raschka
b3dc7073ee
fix ch07 unit test ( #470 )
2025-01-05 17:40:57 -06:00
Sebastian Raschka
7659af7cdd
Add backup URL for gpt2 weights ( #469 )
...
* Add backup URL for gpt2 weights
* newline
2025-01-05 11:28:09 -06:00
QS
976c92010c
typo fixed ( #468 )
...
* typo fixed
* only update plot
---------
Co-authored-by: rasbt <mail@sebastianraschka.com>
2025-01-05 09:17:13 -06:00
Tao Qian
65ee619d3b
Minor readability improvement in dataloader.ipynb ( #461 )
...
* Minor readability improvement in dataloader.ipynb
- The tokenizer and encoded_text variables at the root level are unused.
- The default params for create_dataloader_v1 are confusing, especially for the default batch_size 4, which happens to be the same as the max_length.
* readability improvements
---------
Co-authored-by: rasbt <mail@sebastianraschka.com>
2025-01-04 11:26:10 -06:00
Sebastian Raschka
05a816e270
fix misplaced parenthesis and update license ( #466 )
2025-01-04 11:14:08 -06:00
casinca
57fdd94358
[minor] typo & comments ( #441 )
...
* typo & comment
- safe -> save
- commenting code: batch_size, seq_len = in_idx.shape
* comment
- adding # NEW for assert num_heads % num_kv_groups == 0
* update memory wording
---------
Co-authored-by: rasbt <mail@sebastianraschka.com>
2024-11-18 19:52:42 +09:00
Daniel Kleine
dcef9b7d6f
Fixed command for row 16 additional experiment ( #439 )
...
* fixed command for row 16 experiment
* Update README.md
---------
Co-authored-by: Sebastian Raschka <mail@sebastianraschka.com>
2024-11-17 06:50:00 +09:00
Sebastian Raschka
841b64f2b9
Add flexible padding bonus experiment ( #438 )
...
* Add flexible padding bonus experiment
* fix links
2024-11-15 08:51:01 +09:00
Sebastian Raschka
541b237eff
Add utility to prevent double execution of certain cells ( #437 )
2024-11-14 19:56:49 +09:00
