58 Commits

Author	SHA1	Message	Date
rasbt	bfa4215774	llama note	2024-09-26 07:41:11 -05:00
Sebastian Raschka	ea9b4e83a4	Add chatpgpt-like user interface (#360) ... * Add chatpgpt-like user interface * fixes	2024-09-17 08:26:44 -05:00
Sebastian Raschka	c2117ca073	topk comment	2024-08-20 20:44:15 -05:00
Sebastian Raschka	01cb137bfd	Note about MPS devices (#329)	2024-08-19 20:58:45 -05:00
Sebastian Raschka	8ef5022511	Note about ch05 mps support (#324)	2024-08-19 07:40:24 -05:00
rasbt	b2858a91c5	remove redundant indentation	2024-08-16 07:54:02 -05:00
rasbt	5f0c55ddee	fix code cell ordering	2024-08-12 19:04:05 -05:00
SSebo	7643c6c0c4	Update ch05.ipynb (#297) ... typo	2024-08-05 07:12:27 -05:00
Sebastian Raschka	08040f024c	Test code in pytorch 2.4 (#285) ... * test code in pytorch 2.4 * update	2024-07-24 21:53:41 -05:00
TITC	6cbe6520a2	47,678-->48,725 (#281)	2024-07-22 21:24:57 -05:00
rasbt	31806828d0	add links to summary sections	2024-06-29 07:33:26 -05:00
rasbt	219f45f808	refresh cross entropy figure	2024-06-29 07:22:23 -05:00
Daniel Kleine	1e69c8e0b5	fixed minor issues (#252) ... * fixed typo * fixed var name in md text	2024-06-29 06:38:25 -05:00
Daniel Kleine	81c843bdc0	minor fixes (#246) ... * removed duplicated white spaces * Update ch07/01_main-chapter-code/ch07.ipynb * Update ch07/05_dataset-generation/llama3-ollama.ipynb * removed duplicated white spaces * fixed title again --------- Co-authored-by: Sebastian Raschka <mail@sebastianraschka.com>	2024-06-25 17:30:30 -05:00
Sebastian Raschka	cf0df54d7d	Show epochs as integers on x-axis (#241) ... * Show epochs as integers on x-axis * Update ch07/01_main-chapter-code/previous_chapters.py * remove extra s * modify exercise plots * update chapter 7 plot * resave ch07 for better file diff	2024-06-23 07:41:25 -05:00
rasbt	977f9c6eac	fix device loading	2024-06-20 08:07:00 -05:00
Sebastian Raschka	7bf70baf10	Remove duplicated cell (#212) ... * add a suggestion since code snippet has been repeated. * remove duplicated cell --------- Co-authored-by: Shuyib <benmainye@gmail.com>	2024-06-15 12:48:34 -05:00
rasbt	c6466990bb	explain truncation in ch05	2024-06-12 19:50:11 -05:00
rasbt	1b1fd21d64	fix typo in comment	2024-06-09 06:14:02 -05:00
rasbt	b352d9ef0a	update loss	2024-05-31 07:30:57 -05:00
Kumar Utsav	bc5d73857c	Update ch05.ipynb ... Fixed incorrect token ids	2024-05-29 20:34:23 +05:30
rasbt	98d453b666	update formatting	2024-05-24 07:20:37 -05:00
rasbt	a5593f9860	change defaults to 0 temp	2024-05-19 09:04:49 -05:00
rasbt	1463b2ae47	use default value for temperature	2024-05-19 08:48:10 -05:00
rasbt	4851d5a0fa	add eos_id option for ch07	2024-05-18 12:35:40 -05:00
speed	45f6e72f40	fix 1024 characters to 1024 tokens (#152)	2024-05-11 13:17:07 -05:00
rasbt	aec169dc12	link formatting	2024-04-30 06:26:23 -05:00
Sebastian Raschka	c70ddff558	Return nan if val loader is empty (#124)	2024-04-20 08:02:30 -05:00
Sebastian Raschka	155ac03f61	use torch no grad for loss (#119)	2024-04-14 08:13:07 -05:00
Sebastian Raschka	dd51d4ad83	Make datesets and loaders compatible with multiprocessing (#118)	2024-04-13 13:57:56 -05:00
Sebastian Raschka	9f3f231ac7	use correct lr	2024-04-12 19:55:07 -04:00
Sebastian Raschka	55ebabf95c	Automated link checking (#117) ... * Automated link checking * Fix links in Jupyter Nbs	2024-04-12 19:08:34 -04:00
Sebastian Raschka	e757091301	Organized setup instructions (#115) ... * Organized setup instructions * update tets * link checker action * raise error upon broken link * fix links * fix links * delete duplicated paragraph	2024-04-10 22:09:46 -04:00
rasbt	58d5bd9e39	address suggestions to improve clarity	2024-04-07 08:41:09 -05:00
rasbt	c5a17393fc	variable renaming for clarity	2024-04-05 07:26:42 -05:00
rasbt	8c36399e7c	rename hparams to settings	2024-04-05 07:24:46 -05:00
Sebastian Raschka	adc2964fc5	Fix Loss in Gutenberg bonus section (#109)	2024-04-04 20:54:09 -05:00
Sebastian Raschka	2de60d1bfb	Rename variable to context_length to make it easier on readers (#106) ... * rename to context length * fix spacing	2024-04-04 07:27:41 -05:00
Sebastian Raschka	3829ccdb34	Remove reundant dropout in MLP module (#105)	2024-04-03 20:19:08 -05:00
rasbt	e14585e954	rename batch to text	2024-04-02 20:46:53 -05:00
rasbt	776a517d18	figure scaling	2024-04-01 08:05:01 -05:00
rasbt	ee096986ea	upload exercise solutions of ch05	2024-03-31 20:28:51 -05:00
rasbt	83adc4a2ac	add weight sizes	2024-03-31 08:48:19 -05:00
rasbt	1c173e4f44	update figures	2024-03-30 09:43:51 -05:00
rasbt	ab1e56a323	reorg files and make standalone download file	2024-03-29 08:16:22 -05:00
rasbt	3c5b288ca0	minor typo fixes	2024-03-28 08:02:05 -05:00
rasbt	88b2dd780a	make batch loss calculatution more efficient	2024-03-27 07:11:56 -05:00
rasbt	3cb5a52a1b	simplify calc_loss_loader	2024-03-26 20:34:50 -05:00
rasbt	9cc9c4244e	simplify	2024-03-26 07:52:36 -05:00
rasbt	12fff1ddcb	add endoftext token	2024-03-26 06:47:05 -05:00