788 Commits

This Branch

This Branch

All Branches

Author	SHA1	Message	Date
Jake Poznanski	89b628d0bb	Slighty better	2025-03-18 17:57:45 +00:00
Jake Poznanski	9344107994	pdf viewr	2025-03-18 17:43:07 +00:00
Jake Poznanski	4939e41154	Flask based review app first attempt	2025-03-18 16:53:36 +00:00
Jake Poznanski	93450c326d	Table miner	2025-03-18 15:33:01 +00:00
Jake Poznanski	b472845f33	Table miners	2025-03-17 20:50:21 +00:00
Jake Poznanski	aee030c42b	Fixing sample dataset, outputting some reports for debugging. Math is good enough for now	2025-03-17 10:59:02 -07:00
Jake Poznanski	dd725636a3	Bump version to v0.1.60 for release v0.1.60	2025-03-17 08:59:18 -07:00
Jake Poznanski	baa00825b0	Don't go down too low in temp	2025-03-17 08:48:19 -07:00
Jake Poznanski	f2951f3f78	Lints	2025-03-17 08:47:57 -07:00
Jake Poznanski	1e42e5ea9a	Faster and nicer equation cache	2025-03-17 08:47:06 -07:00
Jake Poznanski	1f8cc59b22	Pipeline scales temperature automatically, increases performance ~2%	2025-03-14 22:27:51 -07:00
Jake Poznanski	4768ac4be5	Merge branch 'main' of https://github.com/allenai/olmocr	2025-03-14 22:32:39 +00:00
Jake Poznanski	0968bd17ce	Mine headers footers	2025-03-14 22:32:38 +00:00
Jake Poznanski	7b4026233c	Benchmark script supports rel paths	2025-03-14 13:22:12 -07:00
Jake Poznanski	1270ca336a	lints	2025-03-14 17:53:43 +00:00
Jake Poznanski	d7361c436e	Basic convert script	2025-03-14 10:35:46 -07:00
Jake Poznanski	142a9cbd20	Convert script to support broader folder structures	2025-03-14 10:12:21 -07:00
Jake Poznanski	98c4283eef	Cap max workers to hopefully improve stability	2025-03-14 10:08:30 -07:00
Jake Poznanski	5f3ef510ab	Faster equation cache and checking, cleanup data script	2025-03-14 16:40:16 +00:00
Jake Poznanski	79e2677319	Hmm, these should be passing!	2025-03-14 02:52:13 +00:00
Jake Poznanski	f5d92bdb14	Trying to get new CI to work	2025-03-14 02:43:55 +00:00
Jake Poznanski	1db1b3406b	Merge pull request #122 from allenai/gpu-ci ... Gpu ci plumbing	2025-03-13 16:05:38 -07:00
Chris Wilhelm	c585415797	for now, only process one pdf in the ci script	2025-03-13 15:48:47 -07:00
Chris Wilhelm	f787625b45	make sure gpu checks only run if normal checks succeed	2025-03-13 15:32:18 -07:00
Chris Wilhelm	9b958e65f1	moves what happens where around a bit and updates readme	2025-03-13 15:31:55 -07:00
Chris Wilhelm	098b01c006	wire it up into a gh action	2025-03-13 15:31:55 -07:00
Chris Wilhelm	7e8492059c	wip	2025-03-13 15:31:55 -07:00
Chris Wilhelm	671e4a7dae	move the gpu reqs to setup.py altogether	2025-03-13 15:31:55 -07:00
Chris Wilhelm	6ac29c781e	actually try setup.py	2025-03-13 15:31:55 -07:00
Chris Wilhelm	927d7d9117	setup.cfg instead of in pyproject for dep links	2025-03-13 15:31:55 -07:00
Chris Wilhelm	f1524957b1	specify gpu deps in pyproject	2025-03-13 15:31:55 -07:00
Chris Wilhelm	29b9054749	basic docker image and test	2025-03-13 15:31:55 -07:00
Jake Poznanski	9f38a8a602	Lints	2025-03-13 22:29:27 +00:00
Jake Poznanski	5009bb31f1	Lints	2025-03-13 22:26:53 +00:00
Jake Poznanski	acb0df32a8	Fixes	2025-03-13 13:15:45 -07:00
Jake Poznanski	3eec2a855b	Mining math	2025-03-13 13:11:01 -07:00
Jake Poznanski	95f03e1e42	More small tests	2025-03-13 12:50:52 -07:00
Jake Poznanski	d30a070234	Tests	2025-03-13 12:34:56 -07:00
Jake Poznanski	269650299c	Much faster and responsive math bench	2025-03-13 10:42:25 -07:00
Jake Poznanski	980121feea	Loading tests much faster in parallel	2025-03-13 10:20:09 -07:00
Jake Poznanski	7729e5a9d7	Graphical pdf test from github	2025-03-13 09:33:40 -07:00
Jake Poznanski	154a07c211	Math miner looks decent	2025-03-12 16:04:03 -07:00
Jake Poznanski	d0b9b5b7a8	Fixes for math mining	2025-03-12 15:49:07 -07:00
Jake Poznanski	09fd299242	Mining	2025-03-12 14:24:47 -07:00
Jake Poznanski	3f92265a81	Math miner working decently	2025-03-12 14:13:17 -07:00
Jake Poznanski	5387a79a2f	More tests for olmocrbench	2025-03-12 11:59:11 -07:00
Jake Poznanski	189104bc90	Fixing escaped html bug in mathml parsing	2025-03-12 11:18:32 -07:00
Jake Poznanski	770bc364ed	Fixes for multipage	2025-03-12 11:09:18 -07:00
Jake Poznanski	0553443301	Convert scripts and other fun	2025-03-12 11:04:20 -07:00
Jake Poznanski	8b3a9e4201	Fixes for multipage runners	2025-03-12 10:29:49 -07:00