169 Commits

Author	SHA1	Message	Date
Jake Poznanski	8d92620d3c	Merge remote-tracking branch 'origin/main' into retry_improvements	2025-05-29 20:33:45 +00:00
Jake Poznanski	cd5b524d20	Some benchmark cleanup	2025-05-29 20:32:25 +00:00
Jake Poznanski	022be37723	Some better info strings in benchmark runner	2025-05-29 18:43:27 +00:00
Jake Poznanski	01c4a561d3	Script fixes	2025-05-29 17:58:11 +00:00
Jake Poznanski	129412cdb0	Git lfs for more reliable downloads	2025-05-29 17:38:00 +00:00
Jake Poznanski	45e0ae59dc	omg	2025-05-29 17:21:58 +00:00
Jake Poznanski	15e0064212	More fixes	2025-05-29 17:20:32 +00:00
Jake Poznanski	e8e6b6cb17	More fixes	2025-05-29 17:19:36 +00:00
Jake Poznanski	06988ac533	Image fixes	2025-05-29 17:18:12 +00:00
Jake Poznanski	ff31faebe4	Runner improvements	2025-05-29 17:12:41 +00:00
Jake Poznanski	475cc1c3a4	Working on runner script	2025-05-29 17:08:05 +00:00
Jake Poznanski	61d427ebf3	Repo cleanup	2025-05-28 17:08:25 +00:00
kyleclo	7a50ee1645	merge	2025-05-25 22:09:05 -07:00
kyleclo	241e5bfe70	Merge branch 'main' of github.com:allenai/olmocr	2025-05-25 22:08:46 -07:00
kyleclo	470394d1cf	pareto plot	2025-05-25 22:07:02 -07:00
Jake Poznanski	d2755adf55	Bump version to v0.1.68 for release	2025-05-19 16:57:20 +00:00
Jake Poznanski	10b5e9e31e	Includes	2025-05-16 21:30:09 +00:00
Jake Poznanski	63aee2c1e5	Code cleanup, version bump, remove unused permutation test	2025-05-16 21:25:32 +00:00
kyleclo	7f4edb240f	pareto plot	2025-05-15 21:05:28 -07:00
Jake Poznanski	bb3fe14543	Pareto plot for paper	2025-05-15 23:57:18 +00:00
Jake Poznanski	d17210f40d	Lint fix	2025-05-14 19:54:19 +00:00
Jake Poznanski	28966b9f14	Adding CDF plots	2025-05-14 16:57:56 +00:00
Jake Poznanski	2e8753af26	Docling runner based on CLI, but its too slow to use. Pii rule fixes	2025-05-14 16:31:56 +00:00
Jake Poznanski	74ef2b6f65	Fixes for some pii taggers	2025-05-13 16:19:50 +00:00
Jake Poznanski	e06fd622c3	Adjusting tagging pipelien v2	2025-05-10 17:43:56 +00:00
Jake Poznanski	623c66c85c	Fixing up tagging pipeline	2025-05-10 17:41:43 +00:00
Jake Poznanski	1854ae1269	A bit more work on tagging	2025-05-09 19:31:07 +00:00
Jake Poznanski	72bcfd8f31	doing some extra pii tagging steps	2025-05-09 15:40:22 +00:00
Jake Poznanski	424052df63	Outputting some nice reference docs to check pii	2025-05-08 21:27:55 +00:00
Jake Poznanski	d18f3f734f	More pii tag checking	2025-05-08 20:07:21 +00:00
Jake Poznanski	80645c886e	Hypothesis checker	2025-05-08 17:58:50 +00:00
Jake Poznanski	3aba3a5c10	Comitting script to get stats on PII tagging	2025-05-08 17:02:36 +00:00
Jake Poznanski	9e5965a95e	Some PII filter	2025-05-06 21:22:27 +00:00
Jake Poznanski	d671be6823	Working on some dataset filtering	2025-05-06 20:49:39 +00:00
Jake Poznanski	da21074477	More nits	2025-05-05 20:43:03 +00:00
Jake Poznanski	a2ec95e0f5	Testing out to see where we stand on qwen2.5	2025-05-05 17:15:09 +00:00
Jake Poznanski	791983c09b	Tweaking some more pii detection	2025-05-01 17:09:05 +00:00
Jake Poznanski	5cc084887a	Rich tagger with bigger model	2025-05-01 09:33:27 -07:00
Jake Poznanski	4ed00d097b	Fixes for rich tagging	2025-04-30 14:38:35 -07:00
Jake Poznanski	472ee108d7	Lints	2025-04-30 21:18:59 +00:00
Jake Poznanski	8ef7e56c86	Trying a new rich tagging pipeline for PII	2025-04-30 21:18:22 +00:00
Jake Poznanski	0a320e9870	Some helper scripts for Aman	2025-04-30 18:47:10 +00:00
Jake Poznanski	f8808478bd	Adding some small changes to the tagging pipeline	2025-04-29 11:12:03 -07:00
Jake Poznanski	66d293c178	Decent resume/cv tagging	2025-04-28 15:57:20 -07:00
Jake Poznanski	1f66b96ffd	Adding openai dependecy for benchmarking	2025-04-25 18:18:37 +00:00
Jake Poznanski	8ec7dbe2e0	Script updates	2025-04-25 18:00:41 +00:00
Jake Poznanski	83002a0de7	Reinit credentials	2025-04-24 20:43:54 +00:00
Jake Poznanski	2d5e1838f4	Small corrections	2025-04-24 20:31:59 +00:00
Jake Poznanski	df71dc38ce	Small fix for cluster usage	2025-04-24 20:24:06 +00:00
Jake Poznanski	67a01cfcc8	FIxups for tagging pipeline	2025-04-24 20:14:42 +00:00