21 Commits

Author SHA1 Message Date
Jake Poznanski
e77bcd20ab Upping vllm versions 2025-07-15 18:43:38 +00:00
Jake Poznanski
e45e871dc9 Cleanup for docker file 2025-06-23 20:05:33 +00:00
Jake Poznanski
a83a0da65f Cleanup of vllm perf branch with @amanr 2025-06-10 21:56:05 +00:00
aman-17
c8a5361d1b fixing packages of 22.04 2025-06-06 13:50:12 -07:00
aman-17
c5d075c63a fixed apt_pkg module 2025-06-06 13:48:48 -07:00
aman-17
08fd82f323 made changes wrt ubuntu 22.04 2025-06-06 13:41:10 -07:00
aman-17
6507a657be updated ubuntu to 22.04 for glbc 2.32 2025-06-06 13:29:51 -07:00
Jake Poznanski
5c52e016e6 Include cuda 12.8 2025-06-02 22:52:28 +00:00
Jake Poznanski
916f0cb919 Trying with flash infer installed 2025-06-02 21:23:04 +00:00
Jake Poznanski
2f1957b401 Performance fixes with vllm backend 2025-06-02 21:10:30 +00:00
Jake Poznanski
d1baa517b7 Python alternatives 2025-06-02 18:59:28 +00:00
Jake Poznanski
581915ffba Fixes for docker image 2025-06-02 18:47:34 +00:00
Jake Poznanski
153f1e58b7 Final uv fixes 2025-06-02 18:39:32 +00:00
Jake Poznanski
97da87a3b2 Hopefully a much better dockerfile 2025-06-02 18:34:47 +00:00
Jake Poznanski
04dd71c6bf Trying to get onto vllm latest 2025-06-02 18:13:22 +00:00
Jake Poznanski
129412cdb0 Git lfs for more reliable downloads 2025-05-29 17:38:00 +00:00
Jake Poznanski
8347e384fd I think this fixes up the docker file 2025-05-29 16:12:06 +00:00
aman-17
ce616c6514 addressed Jake's comments 2025-05-28 19:01:01 -07:00
aman-17
acc2687f21 Updated dockerfile and added a file 2025-05-28 14:35:23 -07:00
aman-17
8bfd1f144b added workflow and fixed readme 2025-05-22 14:28:40 -07:00
aman-17
07b639726d added Dockerfile and its instructions 2025-05-21 10:57:04 -07:00