yujunjun/olmocr
1
0
Fork 0
mirror of https://github.com/allenai/olmocr.git synced 2025-08-13 11:22:30 +00:00
Code Issues Packages Projects Releases Wiki Activity

Try lora run higher LR

Browse Source
This commit is contained in:
Jake Poznanski 2024-10-17 17:12:35 +00:00
parent 2826bcad18
commit e141c91e5e
1 changed files with 1 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2
pdelfin/train/config/qwen2vl-7b-lora.yaml
View File

@ -46,7 +46,7 @@ hparams:
gradient_accumulation_steps: 4 gradient_accumulation_steps: 4
gradient_checkpointing: true gradient_checkpointing: true
clip_grad_norm: 1.0 clip_grad_norm: 1.0
learning_rate: 1e-4 learning_rate: 3e-4
max_steps: 10000 max_steps: 10000
pad_multiple_of: 16 pad_multiple_of: 16
log_every_steps: 10 log_every_steps: 10