257 Commits

Author	SHA1	Message	Date
Jake Poznanski	1d007d1bf2	Perhaps fixing default config	2025-06-30 22:58:21 +00:00
Jake Poznanski	e7020c7f50	More configs	2025-06-30 22:49:42 +00:00
Jake Poznanski	5c2d69a3d7	Some cleanup stuff	2025-06-30 21:24:35 +00:00
Jake Poznanski	656dbef833	Frontier configs	2025-06-30 17:43:30 +00:00
Jake Poznanski	e2f2d36e4f	More typos	2025-06-30 17:41:19 +00:00
Jake Poznanski	55a737ca6b	script	2025-06-30 17:32:01 +00:00
Jake Poznanski	ba49fd53d9	frontier train script let's see what happens	2025-06-30 17:30:17 +00:00
Jake Poznanski	b96454b786	Merge branch 'main' into jakep/new_trainer	2025-06-27 16:21:58 +00:00
Jake Poznanski	1451dd1395	weka	2025-06-27 02:57:26 +00:00
Jake Poznanski	dee3730231	Gantry stuff	2025-06-26 18:34:53 +00:00
Jake Poznanski	0d7836b111	Basic atttempt to run trainer script	2025-06-25 23:22:59 +00:00
Jake Poznanski	d7e5037192	New trainer launch script cleanups	2025-06-25 23:05:32 +00:00
Jake Poznanski	ec5c5b6444	Updating pareto plots	2025-06-17 21:41:23 +00:00
Jake Poznanski	6c51829ae6	Some helper scripts	2025-06-17 21:21:50 +00:00
Jake Poznanski	1295e171bb	Merge branch 'main' of https://github.com/allenai/olmocr	2025-06-12 22:35:09 +00:00
Jake Poznanski	37090e2801	Go back to workers 1 in marker test script	2025-06-12 22:35:08 +00:00
Jake Poznanski	af02f15f24	Merge pull request #236 from VikParuchuri/main ... Fix marker benchmarks	2025-06-12 15:24:17 -07:00
Jake Poznanski	3da6e2d587	Pareto plot update, keep cost the same for now	2025-06-12 22:23:41 +00:00
Jake Poznanski	fcd8bbec92	Install aws cli	2025-06-12 21:38:28 +00:00
Jake Poznanski	fc06797bec	aws cli	2025-06-12 21:29:39 +00:00
Jake Poznanski	59e0a1ccb0	Marker wants newer torchvision	2025-06-12 21:23:53 +00:00
Jake Poznanski	0f3b45c1a3	Add time	2025-06-12 21:19:17 +00:00
Jake Poznanski	4bfcfce767	Actually install the right thing	2025-06-12 21:18:58 +00:00
Jake Poznanski	f8dfd85765	Script	2025-06-12 21:13:31 +00:00
Jake Poznanski	044874a634	Adding marker benchmark	2025-06-12 21:12:58 +00:00
Jake Poznanski	9787d007b9	Pulling in bigger benchmark script from vllm branch to main	2025-06-12 21:02:46 +00:00
Jake Poznanski	43c94fea58	Bencharmk update	2025-06-12 20:47:58 +00:00
Jake Poznanski	b1e064f8a6	Run benchmark script will also start a job to convert 10k docs from olmocr-mix to check performance	2025-06-12 20:27:50 +00:00
Jake Poznanski	0689676026	Rendering the pdfs in the dataloader	2025-06-11 18:11:42 +00:00
Jake Poznanski	f0d8ff7bd3	First attempt at new trainer code	2025-06-11 16:56:16 +00:00
Jake Poznanski	25dfe0b831	Weird glibc error	2025-06-06 18:53:52 +00:00
Vik Paruchuri	267f52bd79	Update marker cost	2025-06-06 13:53:50 -04:00
Jake Poznanski	9539eab840	AWs creds fix	2025-06-06 17:45:17 +00:00
Jake Poznanski	e0fda1a77d	Passing aws creds to benchmark so we can run custom models stored in s3	2025-06-05 17:40:14 +00:00
Jake Poznanski	ecf0d48a28	Dont allow uncomitted changes	2025-06-05 17:22:12 +00:00
Jake Poznanski	134bba9fcd	Run benchmark adjustments	2025-06-05 17:21:06 +00:00
Jake Poznanski	7009a7a9d9	Trying out FP8 compression	2025-06-05 17:18:20 +00:00
Vik Paruchuri	f21ff08c2f	Fix marker benchmarks	2025-06-04 23:10:14 -07:00
Jake Poznanski	8d92620d3c	Merge remote-tracking branch 'origin/main' into retry_improvements	2025-05-29 20:33:45 +00:00
Jake Poznanski	cd5b524d20	Some benchmark cleanup	2025-05-29 20:32:25 +00:00
Jake Poznanski	022be37723	Some better info strings in benchmark runner	2025-05-29 18:43:27 +00:00
Jake Poznanski	01c4a561d3	Script fixes	2025-05-29 17:58:11 +00:00
Jake Poznanski	129412cdb0	Git lfs for more reliable downloads	2025-05-29 17:38:00 +00:00
Jake Poznanski	45e0ae59dc	omg	2025-05-29 17:21:58 +00:00
Jake Poznanski	15e0064212	More fixes	2025-05-29 17:20:32 +00:00
Jake Poznanski	e8e6b6cb17	More fixes	2025-05-29 17:19:36 +00:00
Jake Poznanski	06988ac533	Image fixes	2025-05-29 17:18:12 +00:00
Jake Poznanski	ff31faebe4	Runner improvements	2025-05-29 17:12:41 +00:00
Jake Poznanski	475cc1c3a4	Working on runner script	2025-05-29 17:08:05 +00:00
Jake Poznanski	61d427ebf3	Repo cleanup	2025-05-28 17:08:25 +00:00