Skip to content

perf(deepseek_v4): fuse switch_mlp gate_proj + up_proj into single gather_qmm #1999

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
adurham wants to merge 2 commits into
base: main
Choose a base branch
from
+146 −118

perf(deepseek_v4): fuse switch_mlp gate_proj + up_proj into single ga…

043caf0
Select commit
Loading
Failed to load commit list.
Open

perf(deepseek_v4): fuse switch_mlp gate_proj + up_proj into single gather_qmm #1999

perf(deepseek_v4): fuse switch_mlp gate_proj + up_proj into single ga…
043caf0
Select commit
Loading
Failed to load commit list.

Workflow runs completed with no jobs