yujunjun/olmocr
1
0
Fork 0
mirror of https://github.com/allenai/olmocr.git synced 2025-11-12 08:28:24 +00:00
Code Issues Packages Projects Releases Wiki Activity

Trying grad checkpoint

Browse Source
This commit is contained in:
Jake Poznanski 2024-10-08 16:11:31 +00:00
parent 4fb7e9b184
commit f5fd9ff53a
1 changed files with 1 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2
pdelfin/train/config/qwen2vl-7b.yaml
View File

@ -52,7 +52,7 @@ hparams:
batch_size: 1 batch_size: 1
eval_batch_size: 1 eval_batch_size: 1
gradient_accumulation_steps: 4 gradient_accumulation_steps: 4
gradient_checkpointing: false gradient_checkpointing: true
clip_grad_norm: 1.0 clip_grad_norm: 1.0
learning_rate: 3e-4 learning_rate: 3e-4
max_steps: 9000 max_steps: 9000