Sebastian Raschka 
							
						 
					 
					
						
						
							
							
						
						
						
							
						
						
							bcfdbd7008 
							
						 
					 
					
						
						
							
							Fix some wording issues in the notes ( #695 )  
						
						
						
						
					 
					
						2025-06-22 13:46:16 -05:00 
						 
				 
			
				
					
						
							
							
								Henry Shi 
							
						 
					 
					
						
						
							
							
						
						
						
							
						
						
							02779f5e35 
							
						 
					 
					
						
						
							
							updated exercise 5.3 ( #615 )  
						
						... 
						
						
						
						* updated exercise 5.3
temperature can be set to 0 to regardless of top_k setting to force deterministic behavior
* fix notebook json
---------
Co-authored-by: Sebastian Raschka <mail@sebastianraschka.com> 
						
						
					 
					
						2025-04-13 13:06:57 -05:00 
						 
				 
			
				
					
						
							
							
								Sebastian Raschka 
							
						 
					 
					
						
						
							
							
						
						
						
							
						
						
							3f93d73d6d 
							
						 
					 
					
						
						
							
							Alt weight loading code via PyTorch ( #585 )  
						
						... 
						
						
						
						* Alt weight loading code via PyTorch
* commit additional files 
						
						
					 
					
						2025-03-27 20:10:23 -05:00 
						 
				 
			
				
					
						
							
							
								Sebastian Raschka 
							
						 
					 
					
						
						
							
							
						
						
						
							
						
						
							c21bfe4a23 
							
						 
					 
					
						
						
							
							Add PyPI package ( #576 )  
						
						... 
						
						
						
						* Add PyPI package
* fixes
* fixes 
						
						
					 
					
						2025-03-23 19:28:49 -05:00 
						 
				 
			
				
					
						
							
							
								Greg Gandenberger 
							
						 
					 
					
						
						
							
							
						
						
						
							
						
						
							c1611d4ea8 
							
						 
					 
					
						
						
							
							Fix minor printing issue and note inconsistency across platforms ( #563 )  
						
						... 
						
						
						
						* Fix printing issue and note inconsistency
* Rerun notebook 
						
						
					 
					
						2025-03-14 15:12:09 -05:00 
						 
				 
			
				
					
						
							
							
								Sebastian Raschka 
							
						 
					 
					
						
						
							
							
						
						
						
							
						
						
							86b714a5e0 
							
						 
					 
					
						
						
							
							Specify UTF-8 encoding in the json load command explicitely ( #557 )  
						
						
						
						
					 
					
						2025-03-05 11:46:21 -06:00 
						 
				 
			
				
					
						
							
							
								Sebastian Raschka 
							
						 
					 
					
						
						
							
							
						
						
						
							
						
						
							5fc78ff9fd 
							
						 
					 
					
						
						
							
							Add a note about "zsh: illegal hardware instruction python" error ( #555 )  
						
						
						
						
					 
					
						2025-03-02 15:18:24 -06:00 
						 
				 
			
				
					
						
							
							
								Sebastian Raschka 
							
						 
					 
					
						
						
							
							
						
						
						
							
						
						
							a6cc574605 
							
						 
					 
					
						
						
							
							Upgrade to NumPy 2.0 ( #520 )  
						
						... 
						
						
						
						* Upgrade to NumPy 2.0
* bump pytorch
* bump pytorch
* bump pytorch
* bump pytorch
* bump pytorch
* update
* update packages 
						
						
					 
					
						2025-02-09 06:21:58 -06:00 
						 
				 
			
				
					
						
							
							
								Sebastian Raschka 
							
						 
					 
					
						
						
							
							
						
						
						
							
						
						
							68e2efe1c9 
							
						 
					 
					
						
						
							
							Mention small discrepancy due to Dropout non-reproducibility in PyTorch ( #519 )  
						
						... 
						
						
						
						* Mention small discrepancy due to Dropout non-reproducibility in PyTorch
* bump pytorch version 
						
						
					 
					
						2025-02-06 14:59:52 -06:00 
						 
				 
			
				
					
						
							
							
								Sebastian Raschka 
							
						 
					 
					
						
						
							
							
						
						
						
							
						
						
							25ea71e713 
							
						 
					 
					
						
						
							
							Alternative weight loading via .safetensors ( #507 )  
						
						
						
						
					 
					
						2025-01-29 08:15:29 -06:00 
						 
				 
			
				
					
						
							
							
								Sebastian Raschka 
							
						 
					 
					
						
						
							
							
						
						
						
							
						
						
							701090815e 
							
						 
					 
					
						
						
							
							Add backup URL for gpt2 weights ( #469 )  
						
						... 
						
						
						
						* Add backup URL for gpt2 weights
* newline 
						
						
					 
					
						2025-01-05 11:28:09 -06:00 
						 
				 
			
				
					
						
							
							
								Sebastian Raschka 
							
						 
					 
					
						
						
							
							
						
						
						
							
						
						
							1b635f760e 
							
						 
					 
					
						
						
							
							fix misplaced parenthesis and update license ( #466 )  
						
						
						
						
					 
					
						2025-01-04 11:14:08 -06:00 
						 
				 
			
				
					
						
							
							
								Sebastian Raschka 
							
						 
					 
					
						
						
							
							
						
						
						
							
						
						
							f61c008c5d 
							
						 
					 
					
						
						
							
							Add missing device transfer in gpt_generate.py ( #436 )  
						
						
						
						
					 
					
						2024-11-14 19:12:53 +09:00 
						 
				 
			
				
					
						
							
							
								rasbt 
							
						 
					 
					
						
						
							
							
						
						
						
							
						
						
							bfa4215774 
							
						 
					 
					
						
						
							
							llama note  
						
						
						
						
					 
					
						2024-09-26 07:41:11 -05:00 
						 
				 
			
				
					
						
							
							
								Sebastian Raschka 
							
						 
					 
					
						
						
							
							
						
						
						
							
						
						
							ea9b4e83a4 
							
						 
					 
					
						
						
							
							Add chatpgpt-like user interface ( #360 )  
						
						... 
						
						
						
						* Add chatpgpt-like user interface
* fixes 
						
						
					 
					
						2024-09-17 08:26:44 -05:00 
						 
				 
			
				
					
						
							
							
								Sebastian Raschka 
							
						 
					 
					
						
						
						
						
							
						
						
							c2117ca073 
							
						 
					 
					
						
						
							
							topk comment  
						
						
						
						
					 
					
						2024-08-20 20:44:15 -05:00 
						 
				 
			
				
					
						
							
							
								rasbt 
							
						 
					 
					
						
						
							
							
						
						
						
							
						
						
							9f0bda7af5 
							
						 
					 
					
						
						
							
							add note about duplicated cell  
						
						
						
						
					 
					
						2024-08-19 21:04:18 -05:00 
						 
				 
			
				
					
						
							
							
								Sebastian Raschka 
							
						 
					 
					
						
						
							
							
						
						
						
							
						
						
							01cb137bfd 
							
						 
					 
					
						
						
							
							Note about MPS devices ( #329 )  
						
						
						
						
					 
					
						2024-08-19 20:58:45 -05:00 
						 
				 
			
				
					
						
							
							
								Sebastian Raschka 
							
						 
					 
					
						
						
							
							
						
						
						
							
						
						
							8ef5022511 
							
						 
					 
					
						
						
							
							Note about ch05 mps support ( #324 )  
						
						
						
						
					 
					
						2024-08-19 07:40:24 -05:00 
						 
				 
			
				
					
						
							
							
								rasbt 
							
						 
					 
					
						
						
							
							
						
						
						
							
						
						
							b2858a91c5 
							
						 
					 
					
						
						
							
							remove redundant indentation  
						
						
						
						
					 
					
						2024-08-16 07:54:02 -05:00 
						 
				 
			
				
					
						
							
							
								rasbt 
							
						 
					 
					
						
						
							
							
						
						
						
							
						
						
							5f0c55ddee 
							
						 
					 
					
						
						
							
							fix code cell ordering  
						
						
						
						
					 
					
						2024-08-12 19:04:05 -05:00 
						 
				 
			
				
					
						
							
							
								SSebo 
							
						 
					 
					
						
						
							
							
						
						
						
							
						
						
							7643c6c0c4 
							
						 
					 
					
						
						
							
							Update ch05.ipynb ( #297 )  
						
						... 
						
						
						
						typo 
						
						
					 
					
						2024-08-05 07:12:27 -05:00 
						 
				 
			
				
					
						
							
							
								Sebastian Raschka 
							
						 
					 
					
						
						
							
							
						
						
						
							
						
						
							08040f024c 
							
						 
					 
					
						
						
							
							Test code in pytorch 2.4 ( #285 )  
						
						... 
						
						
						
						* test code in pytorch 2.4
* update 
						
						
					 
					
						2024-07-24 21:53:41 -05:00 
						 
				 
			
				
					
						
							
							
								TITC 
							
						 
					 
					
						
						
							
							
						
						
						
							
						
						
							6cbe6520a2 
							
						 
					 
					
						
						
							
							47,678-->48,725 ( #281 )  
						
						
						
						
					 
					
						2024-07-22 21:24:57 -05:00 
						 
				 
			
				
					
						
							
							
								Sebastian Raschka 
							
						 
					 
					
						
						
							
							
						
						
						
							
						
						
							8d02cb1cee 
							
						 
					 
					
						
						
							
							Add download help message ( #274 )  
						
						
						
						
					 
					
						2024-07-19 08:29:29 -05:00 
						 
				 
			
				
					
						
							
							
								rasbt 
							
						 
					 
					
						
						
							
							
						
						
						
							
						
						
							31806828d0 
							
						 
					 
					
						
						
							
							add links to summary sections  
						
						
						
						
					 
					
						2024-06-29 07:33:26 -05:00 
						 
				 
			
				
					
						
							
							
								rasbt 
							
						 
					 
					
						
						
							
							
						
						
						
							
						
						
							219f45f808 
							
						 
					 
					
						
						
							
							refresh cross entropy figure  
						
						
						
						
					 
					
						2024-06-29 07:22:23 -05:00 
						 
				 
			
				
					
						
							
							
								Daniel Kleine 
							
						 
					 
					
						
						
							
							
						
						
						
							
						
						
							1e69c8e0b5 
							
						 
					 
					
						
						
							
							fixed minor issues ( #252 )  
						
						... 
						
						
						
						* fixed typo
* fixed var name in md text 
						
						
					 
					
						2024-06-29 06:38:25 -05:00 
						 
				 
			
				
					
						
							
							
								Daniel Kleine 
							
						 
					 
					
						
						
							
							
						
						
						
							
						
						
							81c843bdc0 
							
						 
					 
					
						
						
							
							minor fixes ( #246 )  
						
						... 
						
						
						
						* removed duplicated white spaces
* Update ch07/01_main-chapter-code/ch07.ipynb
* Update ch07/05_dataset-generation/llama3-ollama.ipynb
* removed duplicated white spaces
* fixed title again
---------
Co-authored-by: Sebastian Raschka <mail@sebastianraschka.com> 
						
						
					 
					
						2024-06-25 17:30:30 -05:00 
						 
				 
			
				
					
						
							
							
								Sebastian Raschka 
							
						 
					 
					
						
						
							
							
						
						
						
							
						
						
							cf0df54d7d 
							
						 
					 
					
						
						
							
							Show epochs as integers on x-axis ( #241 )  
						
						... 
						
						
						
						* Show epochs as integers on x-axis
* Update ch07/01_main-chapter-code/previous_chapters.py
* remove extra s
* modify exercise plots
* update chapter 7 plot
* resave ch07 for better file diff 
						
						
					 
					
						2024-06-23 07:41:25 -05:00 
						 
				 
			
				
					
						
							
							
								rasbt 
							
						 
					 
					
						
						
							
							
						
						
						
							
						
						
							143a529c33 
							
						 
					 
					
						
						
							
							update generate to match output in main chapter  
						
						
						
						
					 
					
						2024-06-22 12:01:51 -05:00 
						 
				 
			
				
					
						
							
							
								Daniel Kleine 
							
						 
					 
					
						
						
							
							
						
						
						
							
						
						
							ad9dd994dc 
							
						 
					 
					
						
						
							
							minor fixes ( #235 )  
						
						... 
						
						
						
						* removed unnecessary imports
* removed unnecessary semicolons
* format markdown
* format markdown
* fixed markdown 
						
						
					 
					
						2024-06-21 08:40:54 -05:00 
						 
				 
			
				
					
						
							
							
								rasbt 
							
						 
					 
					
						
						
							
							
						
						
						
							
						
						
							6c84900af7 
							
						 
					 
					
						
						
							
							remove redundant line  
						
						
						
						
					 
					
						2024-06-20 10:12:28 -05:00 
						 
				 
			
				
					
						
							
							
								rasbt 
							
						 
					 
					
						
						
							
							
						
						
						
							
						
						
							977f9c6eac 
							
						 
					 
					
						
						
							
							fix device loading  
						
						
						
						
					 
					
						2024-06-20 08:07:00 -05:00 
						 
				 
			
				
					
						
							
							
								rasbt 
							
						 
					 
					
						
						
							
							
						
						
						
							
						
						
							283397aaf2 
							
						 
					 
					
						
						
							
							add main and optional sections  
						
						
						
						
					 
					
						2024-06-19 17:48:25 -05:00 
						 
				 
			
				
					
						
							
							
								Daniel Kleine 
							
						 
					 
					
						
						
							
							
						
						
						
							
						
						
							bbb2a0c3d5 
							
						 
					 
					
						
						
							
							fixed num_workers ( #229 )  
						
						... 
						
						
						
						* fixed num_workers
* ch06 & ch07: added num_workers to create_dataloader_v1 
						
						
					 
					
						2024-06-19 17:36:46 -05:00 
						 
				 
			
				
					
						
							
							
								Sebastian Raschka 
							
						 
					 
					
						
						
							
							
						
						
						
							
						
						
							7bf70baf10 
							
						 
					 
					
						
						
							
							Remove duplicated cell ( #212 )  
						
						... 
						
						
						
						* add a suggestion since code snippet has been repeated.
* remove duplicated cell
---------
Co-authored-by: Shuyib <benmainye@gmail.com> 
						
						
					 
					
						2024-06-15 12:48:34 -05:00 
						 
				 
			
				
					
						
							
							
								rasbt 
							
						 
					 
					
						
						
							
							
						
						
						
							
						
						
							c6466990bb 
							
						 
					 
					
						
						
							
							explain truncation in ch05  
						
						
						
						
					 
					
						2024-06-12 19:50:11 -05:00 
						 
				 
			
				
					
						
							
							
								Sebastian Raschka 
							
						 
					 
					
						
						
							
							
						
						
						
							
						
						
							bcccda728b 
							
						 
					 
					
						
						
							
							check gpt files ( #208 )  
						
						
						
						
					 
					
						2024-06-12 07:19:10 -05:00 
						 
				 
			
				
					
						
							
							
								rasbt 
							
						 
					 
					
						
						
							
							
						
						
						
							
						
						
							1b1fd21d64 
							
						 
					 
					
						
						
							
							fix typo in comment  
						
						
						
						
					 
					
						2024-06-09 06:14:02 -05:00 
						 
				 
			
				
					
						
							
							
								Sebastian Raschka 
							
						 
					 
					
						
						
							
							
						
						
						
							
						
						
							72a073bbbf 
							
						 
					 
					
						
						
							
							Remove leftover instances of self.tokenizer ( #201 )  
						
						... 
						
						
						
						* Remove leftover instances of self.tokenizer
* add endoftext token 
						
						
					 
					
						2024-06-08 14:57:34 -05:00 
						 
				 
			
				
					
						
							
							
								rasbt 
							
						 
					 
					
						
						
							
							
						
						
						
							
						
						
							b352d9ef0a 
							
						 
					 
					
						
						
							
							update loss  
						
						
						
						
					 
					
						2024-05-31 07:30:57 -05:00 
						 
				 
			
				
					
						
							
							
								Kumar Utsav 
							
						 
					 
					
						
						
							
							
						
						
						
							
						
						
							bc5d73857c 
							
						 
					 
					
						
						
							
							Update ch05.ipynb  
						
						... 
						
						
						
						Fixed incorrect token ids 
						
						
					 
					
						2024-05-29 20:34:23 +05:30 
						 
				 
			
				
					
						
							
							
								rasbt 
							
						 
					 
					
						
						
							
							
						
						
						
							
						
						
							98d453b666 
							
						 
					 
					
						
						
							
							update formatting  
						
						
						
						
					 
					
						2024-05-24 07:20:37 -05:00 
						 
				 
			
				
					
						
							
							
								Daniel Kleine 
							
						 
					 
					
						
						
						
						
							
						
						
							aa67e6e1ac 
							
						 
					 
					
						
						
							
							removed unnecessary .gitignore  
						
						
						
						
					 
					
						2024-05-21 19:25:16 +00:00 
						 
				 
			
				
					
						
							
							
								rasbt 
							
						 
					 
					
						
						
							
							
						
						
						
							
						
						
							a5593f9860 
							
						 
					 
					
						
						
							
							change defaults to 0 temp  
						
						
						
						
					 
					
						2024-05-19 09:04:49 -05:00 
						 
				 
			
				
					
						
							
							
								rasbt 
							
						 
					 
					
						
						
							
							
						
						
						
							
						
						
							1463b2ae47 
							
						 
					 
					
						
						
							
							use default value for temperature  
						
						
						
						
					 
					
						2024-05-19 08:48:10 -05:00 
						 
				 
			
				
					
						
							
							
								rasbt 
							
						 
					 
					
						
						
							
							
						
						
						
							
						
						
							4851d5a0fa 
							
						 
					 
					
						
						
							
							add eos_id option for ch07  
						
						
						
						
					 
					
						2024-05-18 12:35:40 -05:00 
						 
				 
			
				
					
						
							
							
								rasbt 
							
						 
					 
					
						
						
							
							
						
						
						
							
						
						
							cd7ea15e8d 
							
						 
					 
					
						
						
							
							add readme  
						
						
						
						
					 
					
						2024-05-13 08:50:55 -05:00 
						 
				 
			
				
					
						
							
							
								speed 
							
						 
					 
					
						
						
							
							
						
						
						
							
						
						
							45f6e72f40 
							
						 
					 
					
						
						
							
							fix 1024 characters to 1024 tokens ( #152 )  
						
						
						
						
					 
					
						2024-05-11 13:17:07 -05:00