yujunjun/olmocr
1
0
Fork 0
mirror of https://github.com/allenai/olmocr.git synced 2025-10-29 00:52:31 +00:00
Code Issues Packages Projects Releases Wiki Activity
85 Commits 78 Branches 33 Tags
Go to file
Clone
Open with VS Code Open with VSCodium Open with Intellij IDEA
Download ZIP Download TAR.GZ Download BUNDLE
Jake Poznanski 05fdb81da2 map and filter on iterable dataset
2024-09-26 19:01:34 +00:00
.github
Running personalize script on template
2024-09-17 15:06:59 +00:00
docs
Running personalize script on template
2024-09-17 15:06:59 +00:00
pdelfin
map and filter on iterable dataset
2024-09-26 19:01:34 +00:00
scripts
7b scripto
2024-09-25 22:08:36 +00:00
tests
Sampling some sequence lengths
2024-09-25 09:05:11 -07:00
.dockerignore
Initial commit
2024-09-17 07:53:43 -07:00
.gitignore
Hoping to get a basic hf Trainer to run
2024-09-20 15:53:11 -07:00
.readthedocs.yaml
Initial commit
2024-09-17 07:53:43 -07:00
CHANGELOG.md
Initial commit
2024-09-17 07:53:43 -07:00
gantry-requirements.txt
bnb
2024-09-26 03:30:35 +00:00
LICENSE
Initial commit
2024-09-17 07:53:43 -07:00
Makefile
Running personalize script on template
2024-09-17 15:06:59 +00:00
pyproject.toml
Smaller config for now, fixing a few requirements
2024-09-23 08:20:08 -07:00
README.md
Running personalize script on template
2024-09-17 15:06:59 +00:00
RELEASE_PROCESS.md
Running personalize script on template
2024-09-17 15:06:59 +00:00
sequence_lengths_histogram.png
Sampling some sequence lengths
2024-09-25 09:05:11 -07:00

README.md

pdelfin

Description
Toolkit for linearizing PDFs for LLM datasets/training
Readme Apache-2.0 373 MiB
Languages
Python 87.7%
Shell 6.5%
HTML 5.7%
Dockerfile 0.1%