473 Commits

This Branch

This Branch

All Branches

Author	SHA1	Message	Date
Jake Poznanski	a14febc79d	sglang support for runeval	2024-11-06 23:19:11 +00:00
Jake Poznanski	592cc50067	More docs	2024-11-04 17:58:46 +00:00
Jake Poznanski	03f5b25d49	Docs good now	2024-11-04 17:37:24 +00:00
Jake Poznanski	d89ea6b9fb	docs	2024-11-04 17:36:37 +00:00
Jake Poznanski	0362ce687f	docs	2024-11-04 17:36:20 +00:00
Jake Poznanski	b2b3f06d8d	docs	2024-11-04 17:35:28 +00:00
Jake Poznanski	46ccab38b2	More docs	2024-11-04 17:34:13 +00:00
Jake Poznanski	93d70683d4	More docs	2024-11-04 17:28:09 +00:00
Jake Poznanski	73bd961135	Logger fix	2024-11-04 17:10:22 +00:00
Jake Poznanski	37782283e0	More docs	2024-11-04 17:08:29 +00:00
Jake Poznanski	ef2e4d6e42	Adding more docs	2024-11-04 16:20:36 +00:00
Jake Poznanski	5ebc8cdd88	Checkfix	2024-11-01 17:13:11 +00:00
Jake Poznanski	9f010e6ab0	Add check for poppler installation	2024-11-01 16:57:19 +00:00
Jake Poznanski	be8fb28799	Update README.md	2024-11-01 09:49:41 -07:00
Jake Poznanski	426fda1f24	Removing some logs	2024-11-01 15:00:49 +00:00
Jake Poznanski	500bd2de5b	flash attn	2024-10-30 22:33:10 +00:00
Jake Poznanski	d45b34fdd5	Trust remote code	2024-10-30 21:22:39 +00:00
Jake Poznanski	cda0ad7984	Config typo	2024-10-30 21:18:48 +00:00
Jake Poznanski	cf3b377bb9	train script	2024-10-30 14:05:02 -07:00
Jake Poznanski	8f001bf74c	Config updates	2024-10-30 14:02:57 -07:00
Jake Poznanski	6a4a55f9e0	Hopefully working molmo HF trainer config	2024-10-30 14:00:27 -07:00
Jake Poznanski	bede854cd5	Startng to write molmo formatters	2024-10-30 13:24:11 -07:00
Jake Poznanski	e65747e591	Some better logging	2024-10-30 11:22:52 -07:00
Jake Poznanski	a0e0917102	Merge branch 'main' of https://github.com/allenai/pdelfin into main	2024-10-30 10:42:56 -07:00
Jake Poznanski	43aa4f2508	Proper selection of LORA weights	2024-10-30 10:42:53 -07:00
Jake Poznanski	c652c7e396	Merge branch 'main' of https://github.com/allenai/pdelfin	2024-10-30 16:26:03 +00:00
Jake Poznanski	85e0e2a61b	Fixing issues with pdf parsing	2024-10-30 16:26:02 +00:00
Jake Poznanski	bcb47946e5	Starting on molmo changes	2024-10-30 08:39:48 -07:00
Jake Poznanski	232c445a23	Pipeline stability fixes hopefully and logging	2024-10-29 20:15:34 +00:00
Jake Poznanski	ce2e4baa87	Applying rotation corrections	2024-10-28 20:32:23 +00:00
Jake Poznanski	08d51b7183	Adding some rotation retry contrl	2024-10-28 20:16:06 +00:00
Jake Poznanski	7678f31aa9	Fixing some reliability issues with the pipeline script	2024-10-28 16:49:00 +00:00
Jake Poznanski	45269fa6a5	Switching to logging vs prints	2024-10-28 15:29:46 +00:00
Jake Poznanski	a3e7654190	Update all docs at once	2024-10-28 15:06:29 +00:00
Jake Poznanski	062abff25c	Adding some skip logic	2024-10-27 21:17:48 +00:00
Jake Poznanski	8e6d0c65d6	swtichin to orjson, some better json error handling	2024-10-25 22:10:54 +00:00
Jake Poznanski	48a3affec3	Reindexing	2024-10-25 20:32:51 +00:00
Jake Poznanski	f13d0a5741	List configs to list	2024-10-24 03:07:32 +00:00
Jake Poznanski	ffe470bf0e	Fix	2024-10-23 22:55:50 +00:00
Jake Poznanski	180dde03c5	dataprep sampling tests	2024-10-23 22:53:05 +00:00
Jake Poznanski	64041bd6d7	Allow sampling different anchor text lens	2024-10-23 15:37:23 -07:00
Jake Poznanski	6a22900b8a	Allow for sampling anchor and other params	2024-10-23 22:26:12 +00:00
Jake Poznanski	999f64dd46	Adding empty anchor support	2024-10-23 22:17:20 +00:00
Jake Poznanski	f8c5aac5a0	Some cleanup	2024-10-23 21:51:54 +00:00
Jake Poznanski	a1a4798ce7	Some crazy idea I had to simplify futures and memory limits	2024-10-23 21:51:37 +00:00
Jake Poznanski	f6ac591fe9	vllm benchmarker	2024-10-23 18:14:50 +00:00
Jake Poznanski	4047258277	Fixing one old bug to make update_static atomic	2024-10-23 17:51:22 +00:00
Jake Poznanski	38dc5a2a0f	Refactored to have a more efficient batchwriter, and also not allow too many running futures	2024-10-23 16:28:46 +00:00
Jake Poznanski	d99096e9a2	Adding vllm profile script for reference	2024-10-22 20:00:34 +00:00
Jake Poznanski	0a5c5068b4	index	2024-10-22 16:03:06 +00:00