22 Commits

Author	SHA1	Message	Date
Jeroen Van Goey	70cfced899	fix typos, add codespell pre-commit hook (#264) ... * fix typos, add codespell pre-commit hook * Update .pre-commit-config.yaml --------- Co-authored-by: Sebastian Raschka <mail@sebastianraschka.com>	2024-07-16 07:07:04 -05:00
Daniel Kleine	fb4e37ae15	fixed minor issues (#252) ... * fixed typo * fixed var name in md text	2024-06-29 06:38:25 -05:00
Daniel Kleine	e5c3c5ce99	minor bug fixes (#207) ... * fixed path arg for create_dataset_csvs() * updated assign_check() to remove user warning	2024-06-12 06:27:56 -05:00
Daniel Kleine	79210eb393	fixes for code (#206) ... * updated .gitignore * removed unused GELU import * fixed model_configs, fixed all tensors on same device * removed unused tiktoken * update * update hparam search * remove redundant tokenizer argument --------- Co-authored-by: rasbt <mail@sebastianraschka.com>	2024-06-11 20:59:48 -05:00
rasbt	b9ed5811c3	fix gradient comment	2024-06-09 20:23:18 -05:00
rasbt	30ba6a3f4b	trainable token -> trainable token position	2024-05-23 11:43:20 -05:00
rasbt	c35cf65dbf	add assertion about data set length	2024-05-23 06:50:43 -05:00
rasbt	8a27baf7c2	experiment with last two blocks	2024-05-21 19:49:34 -05:00
rasbt	7b9b53c9f2	update lora init	2024-05-19 20:11:56 -05:00
rasbt	faffebae4b	add ignore index experiment	2024-05-19 07:24:49 -05:00
rasbt	bdea15f6c6	new experiment w/o causal mask	2024-05-18 17:03:36 -05:00
rasbt	10ebc47720	Add experiment with gradient accumulation	2024-05-17 21:31:22 -05:00
rasbt	623bc19665	fix no padding option	2024-05-17 21:06:51 -05:00
rasbt	f1db50fe9a	fix indent	2024-05-17 07:58:01 -05:00
rasbt	2653c36957	Add new experiment without padding	2024-05-17 07:55:51 -05:00
Sebastian Raschka	cfa1d0f997	Add LoRA experiments (#151) ... * Add LoRA experiments * Update ch06/02_bonus_additional-experiments/additional-experiments.py	2024-05-10 07:26:41 -05:00
rasbt	75545e4c1b	experiments with largest model	2024-05-09 07:40:09 -05:00
rasbt	9457676640	ouput -> output	2024-05-05 12:21:10 -05:00
rasbt	354bb35726	use training set len	2024-04-29 21:50:07 -05:00
rasbt	51f4980a42	style checks	2024-04-24 07:48:51 -05:00
rasbt	fb54b064c9	add more experiments	2024-04-24 07:23:11 -05:00
rasbt	881075aeb0	rename folder	2024-04-23 21:02:57 -05:00