yujunjun/olmocr
1
0
Fork 0
mirror of https://github.com/allenai/olmocr.git synced 2025-08-31 12:25:54 +00:00
Code Issues Packages Projects Releases Wiki Activity

Put LR back, need to save larger checkpoints to weka to prevent timeouts

Browse Source
This commit is contained in:
Jake Poznanski 2024-10-17 19:46:25 +00:00
parent e141c91e5e
commit 529d51d57d
2 changed files with 2 additions and 2 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2
pdelfin/train/config/qwen2vl-7b-lora.yaml
View File

@ -46,7 +46,7 @@ hparams:
gradient_accumulation_steps: 4 gradient_accumulation_steps: 4
gradient_checkpointing: true gradient_checkpointing: true
clip_grad_norm: 1.0 clip_grad_norm: 1.0
learning_rate: 3e-4 learning_rate: 1e-4
max_steps: 10000 max_steps: 10000
pad_multiple_of: 16 pad_multiple_of: 16
log_every_steps: 10 log_every_steps: 10

2
scripts/qwen2vl-7b-gantry.sh
View File

@ -10,7 +10,7 @@ then
fi fi
EXTRA_ARGS="-c pdelfin/train/config/qwen2vl-7b.yaml --num_proc 64 --save.path \"s3://ai2-oe-data/jakep/experiments/qwen2vl-pdf/v1/models/\${BEAKER_USER_ID}\"" EXTRA_ARGS="-c pdelfin/train/config/qwen2vl-7b.yaml --num_proc 64 --save.path \"/data/jakep/experiments/qwen2vl-pdf/v1/models/\${BEAKER_USER_ID}\""
run_name=$(basename "$0" .sh) run_name=$(basename "$0" .sh)