yujunjun/olmocr
1
0
Fork 0
mirror of https://github.com/allenai/olmocr.git synced 2025-10-26 23:53:31 +00:00
Code Issues Packages Projects Releases Wiki Activity

Repackager is still not working right

Browse Source
This commit is contained in:
Jake Poznanski 2025-10-09 22:01:01 +00:00
parent 4c21e15d0e
commit 557bb9a5e9
5 changed files with 1 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2
olmocr/data/repackage_olmocrmix.py
View File

@ -54,7 +54,7 @@ def infer_doc_id(md_path: Path, processed_root: Path) -> str:
rel = md_path.relative_to(processed_root) rel = md_path.relative_to(processed_root)
if len(rel.parts) < 2: if len(rel.parts) < 2:
stem = rel.stem stem = rel.stem
prefix = rel.stem[:4] prefix = rel.stem
else: else:
prefix = rel.parts[0] prefix = rel.parts[0]
stem = Path(rel.parts[-1]).stem stem = Path(rel.parts[-1]).stem

0
tests/sample_dataset/0000/blanktext.md → tests/sample_dataset/empty_document/blanktext.md
View File

0
tests/sample_dataset/0000/blanktext.pdf → tests/sample_dataset/empty_document/blanktext.pdf
View File

0
tests/sample_dataset/0000/edgar.md → tests/sample_dataset/simple_document/edgar.md
View File

0
tests/sample_dataset/0000/edgar.pdf → tests/sample_dataset/simple_document/edgar.pdf
View File