yujunjun/olmocr
1
0
Fork 0
mirror of https://github.com/allenai/olmocr.git synced 2025-10-11 08:12:22 +00:00
Code Issues Packages Projects Releases Wiki Activity

Add chunked prefill and limit mm per prompt options

Browse Source
This commit is contained in:
Charitarth Chugh 2025-09-25 14:29:49 -04:00 committed by GitHub
parent 8f88a98e5d
commit fe425fde20
No known key found for this signature in database
GPG Key ID: B5690EEEBB952194
1 changed files with 2 additions and 0 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2
olmocr/pipeline.py
View File

@ -599,6 +599,8 @@ async def vllm_server_task(model_name_or_path, args, semaphore, unknown_args=Non
str(args.tensor_parallel_size),
"--data-parallel-size",
str(args.data_parallel_size),
"--enable-chunked-prefill",
"--limit-mm-per-prompt '{\"video\": 0}'"
]
if args.gpu_memory_utilization is not None: