yujunjun/olmocr
1
0
Fork 0
mirror of https://github.com/allenai/olmocr.git synced 2025-10-13 01:02:26 +00:00
Code Issues Packages Projects Releases Wiki Activity
1,713 Commits 73 Branches 30 Tags
Commit Graph

1713 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Jake Poznanski
022d87fb7a Another attempt at playwright rendering fix for long RL jobs 2025-09-22 20:47:58 +00:00
Jake Poznanski
97db9cdfb1 Hmm 2025-09-22 18:46:55 +00:00
Jake Poznanski
4e77ecac3f Ok, should have a cleaner playwright story on multithreaded environments 2025-09-22 18:14:30 +00:00
Jake Poznanski
1a64728420 Checking to see if specifying number of dataloader workers helps thread issue 2025-09-22 17:08:06 +00:00
Jake Poznanski
3b20322eb0 Adding some more debug stuff to try to figure out playwright issue 2025-09-22 16:03:49 +00:00
Jake Poznanski
780bc7d934 Better context manager and cleanup of old browser instances 2025-09-21 23:38:09 +00:00
Jake Poznanski
7e786c79c5 Save total limit 2025-09-20 19:52:34 +00:00
Jake Poznanski
83d965c768 Adding contam check for olmocr-bench when making synth data 2025-09-20 03:42:42 +00:00
Jake Poznanski
a8ad6c12b5 Convert fix 2025-09-19 17:36:34 +00:00
Jake Poznanski
b1242db8e2 last threading fix 2025-09-19 17:23:12 +00:00
Jake Poznanski
0a74746da9 Ugh 2025-09-19 17:20:28 +00:00
Jake Poznanski
f114a7fbec Crahses 2025-09-19 17:19:12 +00:00
Jake Poznanski
b52ac23073 Fixing non async threading 2025-09-19 17:12:22 +00:00
Jake Poznanski
e607b53748 Keeps getting killed 2025-09-19 17:02:02 +00:00
Jake Poznanski
cedd4a80cf Fixing paddle ocr to run fast 2025-09-19 16:57:05 +00:00
Jake Poznanski
8f75ea062e testing paddle 2025-09-19 16:55:01 +00:00
Jake Poznanski
e9ab2fd1bb Adding paddlepaddle v5 runner for benchmarking 2025-09-19 16:45:53 +00:00
Jake Poznanski
1c703917df Synthmix ignore 2025-09-19 15:58:58 +00:00
Jake Poznanski
4907b1c700 Bumping rotation augment a tad 2025-09-18 20:38:02 +00:00
Jake Poznanski
a42d8199cd Adding 1025 mix dataset, should be ready for final run 2025-09-18 19:50:40 +00:00
Jake Poznanski
1ac72ad169 Adding some scripts to clean data 2025-09-18 19:44:30 +00:00
Jake Poznanski
30750f77c1 Ok, rendering smaller version of the page, since this is the max suppored by claude and it would get rescaled anyways 2025-09-17 19:51:03 +00:00
Jake Poznanski
a60c84ed14 Maybe better scaling with no losing of text 2025-09-16 22:01:49 +00:00
Jake Poznanski
52df81873a Glob path fixes 2025-09-16 21:42:46 +00:00
Jake Poznanski
3b729d6770 Oops fixing random gen things 2025-09-16 21:17:12 +00:00
Jake Poznanski
2fa67a980e More reliable test gen 2025-09-16 19:57:00 +00:00
Jake Poznanski
e3e09c04db Synth data fixups 2025-09-16 18:47:54 +00:00
Jake Poznanski
2400744673 More generic model name loading 2025-09-11 17:44:24 +00:00
Jake Poznanski
3ae0f30f98 Adjusted the dolma viewer so I can more easily vibe check some new model outputs 2025-09-11 17:32:20 +00:00
Jake Poznanski
0516ff035f More viewer updates 2025-09-11 17:00:49 +00:00
Jake Poznanski
0ffcdc0272 Cleaner viewer 2025-09-11 16:49:10 +00:00
Jake Poznanski
3865e92e7e more rotation new mix without filtering 2025-09-10 21:34:47 +00:00
Jake Poznanski
1ee3dce948 Oops 2025-09-10 17:01:15 +00:00
Jake Poznanski
43ccd82609 One more train config with rotation augments 2025-09-10 16:06:04 +00:00
Jake Poznanski
3eaa584ed5 Fixing data config 2025-09-09 15:22:04 +00:00
Jake Poznanski
077e3eea7f Preemptible mix 2025-09-09 14:55:01 +00:00
Jake Poznanski
54cd5a3438 Going to train on the new transcripts data 2025-09-08 22:30:40 +00:00
Jake Poznanski
592a669e1f Arxiv downloader 2025-09-08 20:44:54 +00:00
Jake Poznanski
607e251530 Mine tables stuff 2025-09-08 20:22:18 +00:00
Jake Poznanski
3e9477db98 Aiming to get some more table data 2025-09-08 20:05:09 +00:00
Jake Poznanski
ba8b3824bf Adding some rotation augmentation to the post training step 2025-09-08 18:54:53 +00:00
Jake Poznanski
a957ab2aaf Adding an adjustment to how blank pages test is run, skipping image tags 2025-09-08 17:18:51 +00:00
Jake Poznanski
c0a1e70440 Adding filter 2025-09-08 17:02:09 +00:00
Jake Poznanski
aad8729ad7 prepare checkpint from main 2025-09-08 17:01:58 +00:00
Jake Poznanski
8f88a98e5d prepare checkpoint script fixes 2025-09-04 22:15:55 +00:00
Jake Poznanski
0f46fa0988 Adding num_generations 2025-09-04 18:44:23 +00:00
Jake Poznanski
ef09c73bf2 Fixing up some rewards stuff 2025-09-04 17:34:53 +00:00
Jake Poznanski
ede0dc51b1 Adding drop last to prevent any weirdnesses 2025-09-04 16:50:08 +00:00
Jake Poznanski
14a882db9a Fixing to new version, adjusting scale rewards stuff 2025-09-03 22:43:35 +00:00
Jake Poznanski
2fd4ae8489 Adding some more options to play with 2025-09-03 22:29:23 +00:00