yujunjun/LLMs-from-scratch
1
0
Fork 0
mirror of https://github.com/rasbt/LLMs-from-scratch.git synced 2025-10-03 03:57:46 +00:00
Code Issues Packages Projects Releases Wiki Activity

use torch no grad for loss (#119)

Browse Source
This commit is contained in:
Sebastian Raschka 2024-04-14 09:13:07 -04:00 committed by GitHub
parent a3a5574758
commit 155ac03f61
No known key found for this signature in database
GPG Key ID: B5690EEEBB952194
1 changed files with 4 additions and 2 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

6
ch05/01_main-chapter-code/ch05.ipynb
View File

@ -1135,8 +1135,10 @@
"\n",
"\n",
"torch.manual_seed(123) # For reproducibility due to the shuffling in the data loader\n",
"train_loss = calc_loss_loader(train_loader, model, device)\n",
"val_loss = calc_loss_loader(val_loader, model, device)\n",
"\n",
"with torch.no_grad(): # Disable gradient tracking for efficiency because we are not training, yet\n",
" train_loss = calc_loss_loader(train_loader, model, device)\n",
" val_loss = calc_loss_loader(val_loader, model, device)\n",
"\n",
"print(\"Training loss:\", train_loss)\n",
"print(\"Validation loss:\", val_loss)"