From 9a1be7e6c2cc00d252ff82189ec2fc04cede63ac Mon Sep 17 00:00:00 2001 From: Jake Poznanski Date: Wed, 29 Jan 2025 11:52:24 -0800 Subject: [PATCH] Readme --- README.md | 4 ++-- 1 file changed, 2 insertions(+), 2 deletions(-) diff --git a/README.md b/README.md index 8672ce3..bdfbaf0 100644 --- a/README.md +++ b/README.md @@ -32,13 +32,13 @@ cd olmocr pip install -e . ``` -Finally, make sure you have sglang with flashinfer installed if you want to do efficient inference +Finally, make sure you have sglang with flashinfer installed if you want to run inference on your own GPU. ```bash pip install sgl-kernel --force-reinstall --no-deps pip install "sglang[all]" --find-links https://flashinfer.ai/whl/cu124/torch2.4/flashinfer/ ``` -## BETA TESTER NOTE: +**BETA TESTER NOTE:** If you are a beta tester, you will need to login using the hugging-face CLI to make sure you have access to https://huggingface.co/allenai/olmocr-preview