yujunjun/LLMs-from-scratch
1
0
Fork 0
mirror of https://github.com/rasbt/LLMs-from-scratch.git synced 2025-11-02 02:41:00 +00:00
Code Issues Packages Projects Releases Wiki Activity

fixed plot_losses (#677)

Browse Source
This commit is contained in:
Daniel Kleine 2025-06-20 01:55:43 +02:00 committed by GitHub
parent 3d4bce6d57
commit e79bb50a1b
1 changed files with 1 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2
ch05/03_bonus_pretraining_on_gutenberg/pretraining_simple.py
View File

@ -228,7 +228,7 @@ if __name__ == "__main__":
)
epochs_tensor = torch.linspace(0, args.n_epochs, len(train_losses))
plot_losses(epochs_tensor, tokens_seen, train_losses, val_losses, output_dir)
plot_losses(epochs_tensor, tokens_seen, train_losses, val_losses)
torch.save(model.state_dict(), output_dir / "model_pg_final.pth")
print(f"Maximum GPU memory allocated: {torch.cuda.max_memory_allocated() / 1e9:.2f} GB")