Jake Poznanski 1fb49cefc1 Working on multi gpu trainer

2025-09-03 17:25:14 +00:00

..

beaker

New trainer launch script cleanups

2025-06-25 23:05:32 +00:00

data

Rendering the pdfs in the dataloader

2025-06-11 18:11:42 +00:00

elo

readme

2025-02-28 10:12:07 -08:00

eval

First attempt at new trainer code

2025-06-11 16:56:16 +00:00

pareto

Updating pareto plots

2025-06-17 21:41:23 +00:00

train

Working on multi gpu trainer

2025-09-03 17:25:14 +00:00

autoscan_dolmadocs.py

Some helper scripts for Aman

2025-04-30 18:47:10 +00:00

benchmark_throughput.py

fixed style

2025-02-25 08:57:02 -08:00

chatgpt_tag_dolmadocs_v1.py

doing some extra pii tagging steps

2025-05-09 15:40:22 +00:00

chatgpt_tag_dolmadocs_v2.py

A bit more work on tagging

2025-05-09 19:31:07 +00:00

check_qual.sh

Bump version to v0.1.68 for release

2025-05-19 16:57:20 +00:00

compare_vllm.sh

Using new budget code

2025-08-06 16:31:08 +00:00

compress_model.sh

Using new budget code

2025-08-06 16:31:08 +00:00

infinigram_count.py

Ruff fixes to CI

2025-03-03 15:56:39 -08:00

jsonl_to_markdown.py

Code cleanup, version bump, remove unused permutation test

2025-05-16 21:25:32 +00:00

movedolmadocs_to_md.py

More cleanup, removing dead adv anchor code

2025-01-30 12:58:11 -08:00

parse_with_pdfminer.py

Repo cleanup

2025-05-28 17:08:25 +00:00

pii_rule_comparison.py

Lint fix

2025-05-14 19:54:19 +00:00

prepare_changelog.py

Black formatting

2025-01-29 15:30:39 -08:00

release_notes.py

Initial commit

2024-09-17 07:53:43 -07:00

release.sh

Fixing release script

2025-02-14 22:57:43 +00:00

rich_tagging_pipeline.py

Using new budget code

2025-08-06 16:31:08 +00:00

run_benchmark_guided_decoding.sh

Using new budget code

2025-08-06 16:31:08 +00:00

run_benchmark.sh

Fixing run_benchmark

2025-08-25 20:28:40 +00:00

run_integration_test.sh

Trying to get new CI to work

2025-03-14 02:43:55 +00:00

run_marker_benchmark.sh

Using new budget code

2025-08-06 16:31:08 +00:00

run_tagging_pipeline.sh

Using new budget code

2025-08-06 16:31:08 +00:00

run_transformers_benchmark.sh

Trying fix for transformers benchmark

2025-08-04 19:50:05 +00:00

s2orc_extractor.sh

S2orc dataset extractor

2024-10-21 21:28:44 +00:00

scan_dolmadocs.py

Update scan_dolmadocs.py

2025-04-22 16:16:21 -07:00

sync_beaker_image.sh

Some helper scripts

2025-06-17 21:21:50 +00:00

tagging_pipeline_v2.py

Using new budget code

2025-08-06 16:31:08 +00:00

tagging_pipeline.py

Using new budget code

2025-08-06 16:31:08 +00:00