We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
There was an error while loading. Please reload this page.
1 parent 88e0712 commit 39538e7Copy full SHA for 39538e7
src/08-01llm/README.md
@@ -0,0 +1,27 @@
1
+# 大模型自定义算子
2
+
3
+## RMS Normalization
4
5
+### Summary
6
7
+```plaintext
8
+ ___ → →
9
+y = (x^2 + δ)^(-1/2) * w * x
10
+```
11
12
+### Attributes
13
14
+- **epsilon - FLOAT** (default is `1e-5`): 防止除 0 异常的小数字 ε。
15
16
+### Inputs
17
18
+2 Inputs:
19
20
+- **X(heterogeneous) - T**: 来自之前算子的输入数据张量。形状为 `N1 x N2 ... D`,`Nx` 可以为任意维度,将在长度为 `D` 的最后一个维度上标准化。
21
+- **W(heterogeneous) - T**: 权重张量。形状为 `D`,`D` 为 `X` 的最后一个维度的长度。
22
23
+### Outputs
24
25
+1 Output:
26
27
+- **Y(heterogeneous) - T**: 输出张量。形状与 `X` 相同。
0 commit comments