1145 Commits

Author SHA1 Message Date
Jake Poznanski
f0d8ff7bd3 First attempt at new trainer code 2025-06-11 16:56:16 +00:00
aman-17
3eda2c04c1 updated vllm to 0.9.1 2025-06-10 16:14:57 -07:00
Jake Poznanski
a83a0da65f Cleanup of vllm perf branch with @amanr 2025-06-10 21:56:05 +00:00
aman-17
316d0af1cd added dtype functionality 2025-06-06 16:19:40 -07:00
aman-17
c8a5361d1b fixing packages of 22.04 2025-06-06 13:50:12 -07:00
aman-17
c5d075c63a fixed apt_pkg module 2025-06-06 13:48:48 -07:00
aman-17
08fd82f323 made changes wrt ubuntu 22.04 2025-06-06 13:41:10 -07:00
aman-17
6507a657be updated ubuntu to 22.04 for glbc 2.32 2025-06-06 13:29:51 -07:00
Jake Poznanski
25dfe0b831 Weird glibc error 2025-06-06 18:53:52 +00:00
Jake Poznanski
9539eab840 AWs creds fix 2025-06-06 17:45:17 +00:00
Jake Poznanski
e0fda1a77d Passing aws creds to benchmark so we can run custom models stored in s3 2025-06-05 17:40:14 +00:00
Jake Poznanski
ecf0d48a28 Dont allow uncomitted changes 2025-06-05 17:22:12 +00:00
Jake Poznanski
134bba9fcd Run benchmark adjustments 2025-06-05 17:21:06 +00:00
Jake Poznanski
7009a7a9d9 Trying out FP8 compression 2025-06-05 17:18:20 +00:00
Jake Poznanski
aad8428dc3 Reverting custom pipeline image 2025-06-02 23:05:48 +00:00
Jake Poznanski
5c52e016e6 Include cuda 12.8 2025-06-02 22:52:28 +00:00
Jake Poznanski
5c524b53ac Cleaning up stats reportng 2025-06-02 21:40:14 +00:00
Jake Poznanski
916f0cb919 Trying with flash infer installed 2025-06-02 21:23:04 +00:00
Jake Poznanski
2ccef7d760 Ugh, this code is bad 2025-06-02 21:22:25 +00:00
Jake Poznanski
2f1957b401 Performance fixes with vllm backend 2025-06-02 21:10:30 +00:00
Jake Poznanski
d71703317d Fixing parse for waiting 2025-06-02 20:05:57 +00:00
Jake Poznanski
d1baa517b7 Python alternatives 2025-06-02 18:59:28 +00:00
Jake Poznanski
581915ffba Fixes for docker image 2025-06-02 18:47:34 +00:00
Jake Poznanski
153f1e58b7 Final uv fixes 2025-06-02 18:39:32 +00:00
Jake Poznanski
97da87a3b2 Hopefully a much better dockerfile 2025-06-02 18:34:47 +00:00
Jake Poznanski
04dd71c6bf Trying to get onto vllm latest 2025-06-02 18:13:22 +00:00
Jake Poznanski
106070dd0e Moving pipeline to vllm 2025-06-02 18:07:31 +00:00
Jake Poznanski
2235b82c8e Beaker tests 2025-05-30 19:49:34 +00:00
Jake Poznanski
967c83d8e7 Better way to setup beaker 2025-05-30 19:42:27 +00:00
Jake Poznanski
23f4a0e460 Bump version to v0.1.71 for release v0.1.71 2025-05-30 18:56:44 +00:00
Jake Poznanski
8b4f6cd621 Upping version 2025-05-30 18:56:34 +00:00
Jake Poznanski
24b6822153 Pushing beaker images now too 2025-05-30 18:56:02 +00:00
Jake Poznanski
208c29d34b Not including fallbacks in olmocr_pipeline bench runner so we can measure direct model performance better 2025-05-30 18:45:55 +00:00
Jake Poznanski
5faf570e30 Format fixes 2025-05-29 23:23:02 +00:00
Jake Poznanski
587b73f23e Try with more aggressive anchor changing 2025-05-29 22:33:16 +00:00
Jake Poznanski
8f5d5bdf28 Revert "Trying to add repetition penalty"
This reverts commit 90f754e7b182f5978f60f5e4734f6ebb0aa3e735.
2025-05-29 21:59:23 +00:00
Jake Poznanski
90f754e7b1 Trying to add repetition penalty 2025-05-29 21:27:13 +00:00
Jake Poznanski
9dcdef6ca3 Going to try with up to 5k tokens 2025-05-29 20:34:05 +00:00
Jake Poznanski
8d92620d3c Merge remote-tracking branch 'origin/main' into retry_improvements 2025-05-29 20:33:45 +00:00
Jake Poznanski
cd5b524d20 Some benchmark cleanup 2025-05-29 20:32:25 +00:00
Jake Poznanski
2cb14cceae ALlowing more tokens 2025-05-29 19:59:58 +00:00
Jake Poznanski
022be37723 Some better info strings in benchmark runner 2025-05-29 18:43:27 +00:00
Jake Poznanski
22ee068d88 Merge remote-tracking branch 'origin/main' into retry_improvements 2025-05-29 18:25:10 +00:00
Jake Poznanski
faddf44897
Merge pull request #218 from allenai/amanr/benchmark_automation
Updated Dockerfile and added a workspace_to_benchmark file
2025-05-29 11:24:30 -07:00
Jake Poznanski
01c4a561d3 Script fixes 2025-05-29 17:58:11 +00:00
Jake Poznanski
129412cdb0 Git lfs for more reliable downloads 2025-05-29 17:38:00 +00:00
Jake Poznanski
45e0ae59dc omg 2025-05-29 17:21:58 +00:00
Jake Poznanski
15e0064212 More fixes 2025-05-29 17:20:32 +00:00
Jake Poznanski
e8e6b6cb17 More fixes 2025-05-29 17:19:36 +00:00
Jake Poznanski
06988ac533 Image fixes 2025-05-29 17:18:12 +00:00