693 Commits

This Branch

This Branch

All Branches

Author	SHA1	Message	Date
Jake Poznanski	60563d6e9a	Merge branch 'main' of https://github.com/allenai/pdelfin	2024-11-08 23:15:04 +00:00
Jake Poznanski	71252a87ec	Debug statements for pipeline	2024-11-08 23:14:44 +00:00
Jake Poznanski	299819e313	Reqs	2024-11-08 15:02:40 -08:00
Jake Poznanski	9d5193538c	some cleanups	2024-11-08 11:38:56 -08:00
Jake Poznanski	65901644e1	Starting to work	2024-11-08 11:04:58 -08:00
Jake Poznanski	82ec24910f	Progress	2024-11-08 10:36:09 -08:00
Jake Poznanski	37dc412335	Working on script	2024-11-08 10:19:00 -08:00
Jake Poznanski	e5fb7c0020	Organization	2024-11-08 09:59:27 -08:00
Jake Poznanski	ee72b3601e	Starting up server and workers async now	2024-11-08 09:14:00 -08:00
Jake Poznanski	a39350e074	Reworking to be async	2024-11-08 08:14:20 -08:00
Jake Poznanski	a103ce730f	Some small things	2024-11-07 23:24:01 +00:00
Jake Poznanski	b15bff64ff	Work queue coallescing	2024-11-07 13:26:42 -08:00
Jake Poznanski	57186c7737	Doing some more stuff	2024-11-07 21:08:46 +00:00
Jake Poznanski	923231e680	exit handlers	2024-11-07 21:00:51 +00:00
Jake Poznanski	051a7b4f6b	Prepping work script	2024-11-07 20:16:23 +00:00
Jake Poznanski	a65e12bea0	Model download stuff	2024-11-07 19:01:45 +00:00
Jake Poznanski	12a91ffa96	Starting on a new approach	2024-11-07 18:21:23 +00:00
Jake Poznanski	faf8659028	Putting aside redis	2024-11-07 16:49:13 +00:00
Jake Poznanski	3d6be3c97b	Work queue sharing thing	2024-11-07 00:11:02 +00:00
Jake Poznanski	75d4a0ec6e	Experimental beaker pipeline self organizing redis idea	2024-11-07 00:03:30 +00:00
Jake Poznanski	a14febc79d	sglang support for runeval	2024-11-06 23:19:11 +00:00
Jake Poznanski	592cc50067	More docs	2024-11-04 17:58:46 +00:00
Jake Poznanski	03f5b25d49	Docs good now	2024-11-04 17:37:24 +00:00
Jake Poznanski	d89ea6b9fb	docs	2024-11-04 17:36:37 +00:00
Jake Poznanski	0362ce687f	docs	2024-11-04 17:36:20 +00:00
Jake Poznanski	b2b3f06d8d	docs	2024-11-04 17:35:28 +00:00
Jake Poznanski	46ccab38b2	More docs	2024-11-04 17:34:13 +00:00
Jake Poznanski	93d70683d4	More docs	2024-11-04 17:28:09 +00:00
Jake Poznanski	73bd961135	Logger fix	2024-11-04 17:10:22 +00:00
Jake Poznanski	37782283e0	More docs	2024-11-04 17:08:29 +00:00
Jake Poznanski	ef2e4d6e42	Adding more docs	2024-11-04 16:20:36 +00:00
Jake Poznanski	5ebc8cdd88	Checkfix	2024-11-01 17:13:11 +00:00
Jake Poznanski	9f010e6ab0	Add check for poppler installation	2024-11-01 16:57:19 +00:00
Jake Poznanski	be8fb28799	Update README.md	2024-11-01 09:49:41 -07:00
Jake Poznanski	426fda1f24	Removing some logs	2024-11-01 15:00:49 +00:00
Jake Poznanski	500bd2de5b	flash attn	2024-10-30 22:33:10 +00:00
Jake Poznanski	d45b34fdd5	Trust remote code	2024-10-30 21:22:39 +00:00
Jake Poznanski	cda0ad7984	Config typo	2024-10-30 21:18:48 +00:00
Jake Poznanski	cf3b377bb9	train script	2024-10-30 14:05:02 -07:00
Jake Poznanski	8f001bf74c	Config updates	2024-10-30 14:02:57 -07:00
Jake Poznanski	6a4a55f9e0	Hopefully working molmo HF trainer config	2024-10-30 14:00:27 -07:00
Jake Poznanski	bede854cd5	Startng to write molmo formatters	2024-10-30 13:24:11 -07:00
Jake Poznanski	e65747e591	Some better logging	2024-10-30 11:22:52 -07:00
Jake Poznanski	a0e0917102	Merge branch 'main' of https://github.com/allenai/pdelfin into main	2024-10-30 10:42:56 -07:00
Jake Poznanski	43aa4f2508	Proper selection of LORA weights	2024-10-30 10:42:53 -07:00
Jake Poznanski	c652c7e396	Merge branch 'main' of https://github.com/allenai/pdelfin	2024-10-30 16:26:03 +00:00
Jake Poznanski	85e0e2a61b	Fixing issues with pdf parsing	2024-10-30 16:26:02 +00:00
Jake Poznanski	bcb47946e5	Starting on molmo changes	2024-10-30 08:39:48 -07:00
Jake Poznanski	232c445a23	Pipeline stability fixes hopefully and logging	2024-10-29 20:15:34 +00:00
Jake Poznanski	ce2e4baa87	Applying rotation corrections	2024-10-28 20:32:23 +00:00