1128 Commits

This Branch

This Branch

All Branches

Author	SHA1	Message	Date
Jake Poznanski	1f8cc59b22	Pipeline scales temperature automatically, increases performance ~2%	2025-03-14 22:27:51 -07:00
Jake Poznanski	4768ac4be5	Merge branch 'main' of https://github.com/allenai/olmocr	2025-03-14 22:32:39 +00:00
Jake Poznanski	0968bd17ce	Mine headers footers	2025-03-14 22:32:38 +00:00
Jake Poznanski	7b4026233c	Benchmark script supports rel paths	2025-03-14 13:22:12 -07:00
Jake Poznanski	1270ca336a	lints	2025-03-14 17:53:43 +00:00
Jake Poznanski	d7361c436e	Basic convert script	2025-03-14 10:35:46 -07:00
Jake Poznanski	142a9cbd20	Convert script to support broader folder structures	2025-03-14 10:12:21 -07:00
Jake Poznanski	98c4283eef	Cap max workers to hopefully improve stability	2025-03-14 10:08:30 -07:00
Jake Poznanski	5f3ef510ab	Faster equation cache and checking, cleanup data script	2025-03-14 16:40:16 +00:00
Jake Poznanski	79e2677319	Hmm, these should be passing!	2025-03-14 02:52:13 +00:00
Jake Poznanski	f5d92bdb14	Trying to get new CI to work	2025-03-14 02:43:55 +00:00
Jake Poznanski	1db1b3406b	Merge pull request #122 from allenai/gpu-ci ... Gpu ci plumbing	2025-03-13 16:05:38 -07:00
Chris Wilhelm	c585415797	for now, only process one pdf in the ci script	2025-03-13 15:48:47 -07:00
Chris Wilhelm	f787625b45	make sure gpu checks only run if normal checks succeed	2025-03-13 15:32:18 -07:00
Chris Wilhelm	9b958e65f1	moves what happens where around a bit and updates readme	2025-03-13 15:31:55 -07:00
Chris Wilhelm	098b01c006	wire it up into a gh action	2025-03-13 15:31:55 -07:00
Chris Wilhelm	7e8492059c	wip	2025-03-13 15:31:55 -07:00
Chris Wilhelm	671e4a7dae	move the gpu reqs to setup.py altogether	2025-03-13 15:31:55 -07:00
Chris Wilhelm	6ac29c781e	actually try setup.py	2025-03-13 15:31:55 -07:00
Chris Wilhelm	927d7d9117	setup.cfg instead of in pyproject for dep links	2025-03-13 15:31:55 -07:00
Chris Wilhelm	f1524957b1	specify gpu deps in pyproject	2025-03-13 15:31:55 -07:00
Chris Wilhelm	29b9054749	basic docker image and test	2025-03-13 15:31:55 -07:00
Jake Poznanski	9f38a8a602	Lints	2025-03-13 22:29:27 +00:00
Jake Poznanski	5009bb31f1	Lints	2025-03-13 22:26:53 +00:00
Jake Poznanski	acb0df32a8	Fixes	2025-03-13 13:15:45 -07:00
Jake Poznanski	3eec2a855b	Mining math	2025-03-13 13:11:01 -07:00
Jake Poznanski	95f03e1e42	More small tests	2025-03-13 12:50:52 -07:00
Jake Poznanski	d30a070234	Tests	2025-03-13 12:34:56 -07:00
Jake Poznanski	269650299c	Much faster and responsive math bench	2025-03-13 10:42:25 -07:00
Jake Poznanski	980121feea	Loading tests much faster in parallel	2025-03-13 10:20:09 -07:00
Jake Poznanski	7729e5a9d7	Graphical pdf test from github	2025-03-13 09:33:40 -07:00
Jake Poznanski	154a07c211	Math miner looks decent	2025-03-12 16:04:03 -07:00
Jake Poznanski	d0b9b5b7a8	Fixes for math mining	2025-03-12 15:49:07 -07:00
Jake Poznanski	09fd299242	Mining	2025-03-12 14:24:47 -07:00
Jake Poznanski	3f92265a81	Math miner working decently	2025-03-12 14:13:17 -07:00
Jake Poznanski	5387a79a2f	More tests for olmocrbench	2025-03-12 11:59:11 -07:00
Jake Poznanski	189104bc90	Fixing escaped html bug in mathml parsing	2025-03-12 11:18:32 -07:00
Jake Poznanski	770bc364ed	Fixes for multipage	2025-03-12 11:09:18 -07:00
Jake Poznanski	0553443301	Convert scripts and other fun	2025-03-12 11:04:20 -07:00
Jake Poznanski	8b3a9e4201	Fixes for multipage runners	2025-03-12 10:29:49 -07:00
Jake Poznanski	743e48e4ad	More fixes	2025-03-11 04:59:19 +00:00
Jake Poznanski	b2fe82db9b	Working on math compares	2025-03-11 04:50:51 +00:00
Jake Poznanski	bc3a94583a	Adding some tests	2025-03-11 03:57:12 +00:00
Jake Poznanski	35cc6f110c	A few fixes for text comparisons and normalized chars	2025-03-11 03:42:51 +00:00
Jake Poznanski	4709156ce5	Leaving with some more data, but still cases to investigate	2025-03-10 15:53:01 -07:00
Jake Poznanski	07be9ea6e3	More math testing	2025-03-10 21:55:33 +00:00
Jake Poznanski	e39c3e4613	New method for comparing equations	2025-03-10 21:47:49 +00:00
Jake Poznanski	fff40506cc	More test documents	2025-03-10 17:09:42 +00:00
Jake Poznanski	0ba56c0fa9	Adjusting repeat test to be the "baseline" test which also looks for disallowed characters	2025-03-10 16:53:07 +00:00
Jake Poznanski	a2b5ca8d41	Better markdown table parsing	2025-03-10 16:40:30 +00:00