Skip to content

Commit e32e544

Browse files
authored
Merge pull request #817 from ideaguy3d/patch-1
Put section number for Section 5 "Equation 2: Multihead Self-Attention (MSA block)"
2 parents 9f1084e + 905290d commit e32e544

File tree

1 file changed

+2
-2
lines changed

1 file changed

+2
-2
lines changed

video_notebooks/08_pytorch_paper_replicating_video.ipynb

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -2500,7 +2500,7 @@
25002500
{
25012501
"cell_type": "markdown",
25022502
"source": [
2503-
"## Equation 2: Multihead Self-Attention (MSA block)\n",
2503+
"## 5. Equation 2: Multihead Self-Attention (MSA block)\n",
25042504
"\n",
25052505
"* **Multihead self-attention** = which part of a sequence should pay the most attention to itself?\n",
25062506
" * In our case, we have a series of embedded image patches, which patch significantly relates to another patch.\n",
@@ -4051,4 +4051,4 @@
40514051
"outputs": []
40524052
}
40534053
]
4054-
}
4054+
}

0 commit comments

Comments
 (0)