Probably need at least 20GB GPU ram to have a good time with olmocr

This commit is contained in:
Jake Poznanski 2025-03-03 15:54:47 -08:00
parent 22418534e1
commit ca0f911997
2 changed files with 2 additions and 2 deletions

View File

@ -38,7 +38,7 @@ What is included:
### Installation
Requirements:
- Recent NVIDIA GPU (tested on RTX 4090, L40S, A100, H100)
- Recent NVIDIA GPU (tested on RTX 4090, L40S, A100, H100) with at least 20 GB of GPU RAM
- 30GB of free disk space
You will need to install poppler-utils and additional fonts for rendering PDF images.

View File

@ -27,7 +27,7 @@ def check_sglang_version():
sys.exit(1)
def check_torch_gpu_available(min_gpu_memory: int = 8 * 1024**3):
def check_torch_gpu_available(min_gpu_memory: int = 20 * 1024**3):
try:
import torch
except: