7 Commits

Author SHA1 Message Date
Sebastian Raschka
992f3068d1 Auto download DPO dataset if not already available in path (#479)
* Auto download DPO dataset if not already available in path

* update tests to account for latest HF transformers release in unit tests

* pep 8
2025-01-12 12:27:28 -06:00
Sebastian Raschka
f8bdfe12e1 RoPE updates (#412)
* RoPE updates

* Apply suggestions from code review

* updates

* updates

* updates
2024-10-23 18:07:49 -05:00
Sebastian Raschka
6dd3fbd79d Update tests.py 2024-10-23 07:48:33 -05:00
Sebastian Raschka
9726ca6546 RoPE increase (#407) 2024-10-21 19:58:38 -05:00
Sebastian Raschka
37db3f0913 Add Llama 3.2 RoPE to CI (#391)
* add Llama 3.2 RoPE to CI

* update
2024-10-08 08:28:34 -05:00
Sebastian Raschka
feb0647c79 Improve rope settings for llama3 (#380) 2024-10-03 08:29:54 -05:00
Sebastian Raschka
b8497c1bf5 Add llama2 unit tests (#372)
* add llama2 unit tests

* update

* updates

* updates

* update file path

* update requirements file

* rmsnorm test

* update
2024-09-25 19:40:36 -05:00