Cleaning up some training requirements installation steps

gantry-train-requirements.txt

@@ -1,6 +0,0 @@
-torchvision
-accelerate
-peft
-wandb
-omegaconf
-einops

olmocr/train/README.md

@@ -9,7 +9,7 @@ The first step is to setup your python/conda environment, and set things up the
 Then, add in some extra training requirements:
 
 ```bash
-pip install -r gantry-train-requirements.txt
+pip install .[train]
 pip install transformers==4.52.4
 pip install flash-attn==2.8.0.post2 --no-build-isolation
 ```

pyproject.toml

@@ -99,13 +99,10 @@ train = [
     "torch",
     "torchvision",
     "accelerate",
-    "datasets",
     "peft",
     "wandb",
     "omegaconf",
-    "s3fs",
-    "necessary",
-    "einops",
+    "einops"
     "augraphy",
 ]
 

scripts/train/newtrainer-beaker.sh

@@ -92,7 +92,7 @@ b = Beaker.from_env(default_workspace="ai2/olmocr")
 
 # Build the training command
 commands = [
-    "pip install -r gantry-train-requirements.txt",
+    "pip install .[train]",
     "pip install transformers==4.52.4",
     "pip install flash-attn==2.8.0.post2 --no-build-isolation",
     "pip install s5cmd",