yujunjun/LLMs-from-scratch
1
0
Fork 0
mirror of https://github.com/rasbt/LLMs-from-scratch.git synced 2025-10-27 07:49:25 +00:00
Code Issues Packages Projects Releases Wiki Activity

use torch no grad for loss (#119)

Browse Source
This commit is contained in:
Sebastian Raschka 2024-04-14 09:13:07 -04:00 committed by GitHub
parent 98f1e97452
commit ef2de4718e
1 changed files with 4 additions and 2 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

6
ch05/01_main-chapter-code/ch05.ipynb
View File

@ -1135,8 +1135,10 @@
"\n", "\n",
"\n", "\n",
"torch.manual_seed(123) # For reproducibility due to the shuffling in the data loader\n", "torch.manual_seed(123) # For reproducibility due to the shuffling in the data loader\n",
"train_loss = calc_loss_loader(train_loader, model, device)\n", "\n",
"val_loss = calc_loss_loader(val_loader, model, device)\n", "with torch.no_grad(): # Disable gradient tracking for efficiency because we are not training, yet\n",
" train_loss = calc_loss_loader(train_loader, model, device)\n",
" val_loss = calc_loss_loader(val_loader, model, device)\n",
"\n", "\n",
"print(\"Training loss:\", train_loss)\n", "print(\"Training loss:\", train_loss)\n",
"print(\"Validation loss:\", val_loss)" "print(\"Validation loss:\", val_loss)"