9 Commits

Author SHA1 Message Date
Sebastian Raschka
b993c2b25b
Improve rope settings for llama3 (#380) 2024-10-03 08:29:54 -05:00
rasbt
278a50a348
add section numbers 2024-09-30 08:42:22 -05:00
Sebastian Raschka
b56d0b2942
Add llama2 unit tests (#372)
* add llama2 unit tests

* update

* updates

* updates

* update file path

* update requirements file

* rmsnorm test

* update
2024-09-25 19:40:36 -05:00
rasbt
a6d8e93da3
improve formatting 2024-09-24 18:49:17 -05:00
Daniel Kleine
ff31b345b0
ch05/07 gpt_to_llama text improvements (#369)
* fixed typo

* fixed RMSnorm formula

* fixed SwiGLU formula

* temperature=0 for untrained model for reproducibility

* added extra info hf token
2024-09-24 18:45:49 -05:00
rasbt
d144bd5b7a
add json import 2024-09-23 09:12:35 -05:00
rasbt
6bc3de165c
move access token to config.json 2024-09-23 08:56:16 -05:00
rasbt
58df945ed4
add llama3 comparison 2024-09-23 08:17:10 -05:00
Sebastian Raschka
0467c8289b
GPT to Llama (#368)
* GPT to Llama

* fix urls
2024-09-23 07:34:06 -05:00