yujunjun/olmocr
1
0
Fork 0
mirror of https://github.com/allenai/olmocr.git synced 2025-10-01 03:14:31 +00:00
Code Issues Packages Projects Releases Wiki Activity
86 Commits 70 Branches 27 Tags
Go to file
Clone
Open with VS Code Open with VSCodium Open with Intellij IDEA
Download ZIP Download TAR.GZ Download BUNDLE
Jake Poznanski cf1aa0176e Proper use of iterable_dataset
2024-09-26 19:55:54 +00:00
.github
Running personalize script on template
2024-09-17 15:06:59 +00:00
docs
Running personalize script on template
2024-09-17 15:06:59 +00:00
pdelfin
Proper use of iterable_dataset
2024-09-26 19:55:54 +00:00
scripts
7b scripto
2024-09-25 22:08:36 +00:00
tests
Proper use of iterable_dataset
2024-09-26 19:55:54 +00:00
.dockerignore
Initial commit
2024-09-17 07:53:43 -07:00
.gitignore
Hoping to get a basic hf Trainer to run
2024-09-20 15:53:11 -07:00
.readthedocs.yaml
Initial commit
2024-09-17 07:53:43 -07:00
CHANGELOG.md
Initial commit
2024-09-17 07:53:43 -07:00
gantry-requirements.txt
bnb
2024-09-26 03:30:35 +00:00
LICENSE
Initial commit
2024-09-17 07:53:43 -07:00
Makefile
Running personalize script on template
2024-09-17 15:06:59 +00:00
pyproject.toml
Smaller config for now, fixing a few requirements
2024-09-23 08:20:08 -07:00
README.md
Running personalize script on template
2024-09-17 15:06:59 +00:00
RELEASE_PROCESS.md
Running personalize script on template
2024-09-17 15:06:59 +00:00
sequence_lengths_histogram.png
Sampling some sequence lengths
2024-09-25 09:05:11 -07:00

README.md

pdelfin

Description
Toolkit for linearizing PDFs for LLM datasets/training
Readme Apache-2.0 364 MiB
Languages
Python 90.2%
HTML 5.7%
Shell 3.9%
Dockerfile 0.2%