anamitev
diff --git a/‎docs/blog/posts/rwkv-explainer/.content.md
+1,704 b/‎docs/blog/posts/rwkv-explainer/.content.md
+1,704
diff --git a/‎docs/blog/posts/rwkv-explainer/RWKV,_Explained.ipynb
+3,572 b/‎docs/blog/posts/rwkv-explainer/RWKV,_Explained.ipynb
+3,572
diff --git a/‎docs/blog/posts/rwkv-explainer/img/0842125a22448b6d132775d653a0efbe4c05bbe1.png
11.5 KB b/‎docs/blog/posts/rwkv-explainer/img/0842125a22448b6d132775d653a0efbe4c05bbe1.png
11.5 KB
diff --git a/‎docs/blog/posts/rwkv-explainer/img/090197d0bef33ce11588804046ae9695eff37333.png
27.1 KB b/‎docs/blog/posts/rwkv-explainer/img/090197d0bef33ce11588804046ae9695eff37333.png
27.1 KB
diff --git a/‎docs/blog/posts/rwkv-explainer/img/13db266f25269be3131be803e0f5c63bbe1f58af.png
40.9 KB b/‎docs/blog/posts/rwkv-explainer/img/13db266f25269be3131be803e0f5c63bbe1f58af.png
40.9 KB
diff --git a/‎docs/blog/posts/rwkv-explainer/img/17655b35a236b4c2299b27959990ccae2718d496.png
15.7 KB b/‎docs/blog/posts/rwkv-explainer/img/17655b35a236b4c2299b27959990ccae2718d496.png
15.7 KB
diff --git a/‎docs/blog/posts/rwkv-explainer/img/377d6e7cee56daf68c2ba0d17ff61d9a4553c4dc.png
7.08 KB b/‎docs/blog/posts/rwkv-explainer/img/377d6e7cee56daf68c2ba0d17ff61d9a4553c4dc.png
7.08 KB
diff --git a/‎docs/blog/posts/rwkv-explainer/img/38185678f17b5e42ec596a71aa65bd50bf897484.png
6.48 KB b/‎docs/blog/posts/rwkv-explainer/img/38185678f17b5e42ec596a71aa65bd50bf897484.png
6.48 KB
diff --git a/‎docs/blog/posts/rwkv-explainer/img/59c97af75e352855e20e733ffdd54375cee4b25a.png
14.9 KB b/‎docs/blog/posts/rwkv-explainer/img/59c97af75e352855e20e733ffdd54375cee4b25a.png
14.9 KB
diff --git a/‎docs/blog/posts/rwkv-explainer/img/5ebf627acb63be744f0554436c85b7ec8ab11abd.png
7.95 KB b/‎docs/blog/posts/rwkv-explainer/img/5ebf627acb63be744f0554436c85b7ec8ab11abd.png
7.95 KB
diff --git a/‎docs/blog/posts/rwkv-explainer/img/5f0a02bf73199b43295db1c23f3cfa98f619dd63.png
6.87 KB b/‎docs/blog/posts/rwkv-explainer/img/5f0a02bf73199b43295db1c23f3cfa98f619dd63.png
6.87 KB
diff --git a/‎docs/blog/posts/rwkv-explainer/img/63e1f7bf9192ab7540bbd4570a9769bb975c075d.png
10.1 KB b/‎docs/blog/posts/rwkv-explainer/img/63e1f7bf9192ab7540bbd4570a9769bb975c075d.png
10.1 KB
diff --git a/‎docs/blog/posts/rwkv-explainer/img/89e15c22a51ff293908024a89c6a3a0c095f5ae8.png
62 KB b/‎docs/blog/posts/rwkv-explainer/img/89e15c22a51ff293908024a89c6a3a0c095f5ae8.png
62 KB
diff --git a/‎docs/blog/posts/rwkv-explainer/img/8f14dc779f290a6cc97beda8392327f0b8d80863.png
6.96 KB b/‎docs/blog/posts/rwkv-explainer/img/8f14dc779f290a6cc97beda8392327f0b8d80863.png
6.96 KB
diff --git a/‎docs/blog/posts/rwkv-explainer/img/b074750a75354cf2d0f95a3917d393c004f55682.png
10.5 KB b/‎docs/blog/posts/rwkv-explainer/img/b074750a75354cf2d0f95a3917d393c004f55682.png
10.5 KB
diff --git a/‎docs/blog/posts/rwkv-explainer/img/b327530f46508ee27503ffa06e7dc2435a29ae8a.png
6.24 KB b/‎docs/blog/posts/rwkv-explainer/img/b327530f46508ee27503ffa06e7dc2435a29ae8a.png
6.24 KB
diff --git a/‎docs/blog/posts/rwkv-explainer/img/b7fc234233c4ea5ef176d42004baa5d583e38886.png
110 KB b/‎docs/blog/posts/rwkv-explainer/img/b7fc234233c4ea5ef176d42004baa5d583e38886.png
110 KB
diff --git a/‎docs/blog/posts/rwkv-explainer/img/daf4b2f07a5f6e547d0dfa5055a604ee3428304d.png
10.4 KB b/‎docs/blog/posts/rwkv-explainer/img/daf4b2f07a5f6e547d0dfa5055a604ee3428304d.png
10.4 KB
diff --git a/‎docs/blog/posts/rwkv-explainer/img/dc5cae73a49390baea914410ac601fba6038b95f.png
7.06 KB b/‎docs/blog/posts/rwkv-explainer/img/dc5cae73a49390baea914410ac601fba6038b95f.png
7.06 KB
diff --git a/‎docs/blog/posts/rwkv-explainer/img/e2d64b4037c2de0dea1d73ab2e376a6e58fa36ad.png
8.02 KB b/‎docs/blog/posts/rwkv-explainer/img/e2d64b4037c2de0dea1d73ab2e376a6e58fa36ad.png
8.02 KB
diff --git a/‎docs/blog/posts/rwkv-explainer/img/e5c2258eab4b31c059aede7377eb225c982948e6.png
23.5 KB b/‎docs/blog/posts/rwkv-explainer/img/e5c2258eab4b31c059aede7377eb225c982948e6.png
23.5 KB
diff --git a/‎docs/blog/posts/rwkv-explainer/img/f4901781021d0298fc1b5ffbde9d4d7f91c92917.png
11.9 KB b/‎docs/blog/posts/rwkv-explainer/img/f4901781021d0298fc1b5ffbde9d4d7f91c92917.png
11.9 KB
diff --git a/‎docs/blog/posts/rwkv-explainer/img/fa6734b45f94b7dfe5911d6c58bc60ff845f1b0e.png
7.07 KB b/‎docs/blog/posts/rwkv-explainer/img/fa6734b45f94b7dfe5911d6c58bc60ff845f1b0e.png
7.07 KB
diff --git a/‎docs/blog/posts/rwkv-explainer/img/fc7fa3a34c4b2b68d0cefb55a2ac0956d5c7c935.png
7.42 KB b/‎docs/blog/posts/rwkv-explainer/img/fc7fa3a34c4b2b68d0cefb55a2ac0956d5c7c935.png
7.42 KB
diff --git a/‎docs/blog/posts/rwkv-explainer/index.md
+39 b/‎docs/blog/posts/rwkv-explainer/index.md
+39
diff --git a/‎mkdocs.yml
+2 b/‎mkdocs.yml
+2
@@ -0,0 +1,39 @@
+---
+title: "RWKV, Explained"
+description: "A step-by-step explanation of the RWKV architecture via typed PyTorch code."
+author: "Charles Frye"
+hide:
+  - navigation
+tags:
+  - llms
+  - rwkv
+  - code
+  - notebook
+embed_image: https://i.imgur.com/W3mhy9f.png
+time: "2023-07-25"
+---
+<div class="author" markdown>
+By [Charles Frye](https://twitter.com/charles_irl).
+</div>
+
+--8<-- "blog/posts/rwkv-explainer/.content.md"
+
+## Acknowledgements
+
+Thanks to
+[Ryan Zarcone](https://twitter.com/r_zarcone)
+for several long {white,chalk}boarding sessions on RWKV
+and to
+[Igor Vasiljevic](https://twitter.com/vslevic),
+[Faris Hijazi](https://twitter.com/theeFaris),
+and
+[Ben Field](https://twitter.com/benfieldddd)
+for helpful comments on drafts.
+
+Also, many thanks to the RWKV team,
+in particular
+[Johan Wind](https://johanwind.github.io),
+whose
+[blog post](https://johanwind.github.io/2023/03/23/rwkv_details.html)
+implementing RWKV in numpy was an invaluable resource
+and provided the initial scaffolding for the code in this post.
@@ -65,6 +65,8 @@ plugins:
       template: overrides/custom-blog.html
       features:
         tags: {}
+      time_format: '%Y-%m-%d'
+      meta_time_format: '%Y-%m-%d'
   - macros
   - search
   - section-index # Make top-level nav sections that contain an index.md clickable