yujunjun/LLMs-from-scratch
1
0
Fork 0
mirror of https://github.com/rasbt/LLMs-from-scratch.git synced 2025-09-23 15:15:26 +00:00
Code Issues Packages Projects Releases Wiki Activity

Simplify embedding vs linear layer code (#278)

Browse Source
This commit is contained in:
Sebastian Raschka 2024-07-21 10:21:10 -07:00 committed by GitHub
parent bbe09e9799
commit fa56c80402
No known key found for this signature in database
GPG Key ID: B5690EEEBB952194
1 changed files with 2 additions and 2 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

4
ch02/03_bonus_embedding-vs-matmul/embeddings-and-linear-layers.ipynb
View File

@ -47,7 +47,7 @@
"name": "stdout", "name": "stdout",
"output_type": "stream", "output_type": "stream",
"text": [ "text": [
"PyTorch version: 2.1.0\n" "PyTorch version: 2.3.1\n"
] ]
} }
], ],
@ -373,7 +373,7 @@
"metadata": {}, "metadata": {},
"outputs": [], "outputs": [],
"source": [ "source": [
"linear.weight = torch.nn.Parameter(embedding.weight.T.detach())" "linear.weight = torch.nn.Parameter(embedding.weight.T)"
] ]
}, },
{ {