yujunjun/olmocr
1
0
Fork 0
mirror of https://github.com/allenai/olmocr.git synced 2025-08-10 18:02:57 +00:00
Code Issues Packages Projects Releases Wiki Activity

Try lora run higher LR

Browse Source
This commit is contained in:
Jake Poznanski 2024-10-17 17:12:35 +00:00
parent 2826bcad18
commit e141c91e5e
1 changed files with 1 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2
pdelfin/train/config/qwen2vl-7b-lora.yaml
View File

@ -46,7 +46,7 @@ hparams:
gradient_accumulation_steps: 4
gradient_checkpointing: true
clip_grad_norm: 1.0
learning_rate: 1e-4
learning_rate: 3e-4
max_steps: 10000
pad_multiple_of: 16
log_every_steps: 10