Skip to content

Add MTP speculative decoding for DeepSeek-V4 #15

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Draft
0xClandestine wants to merge 2 commits into
base: pc/add-deepseekv4flash-model
Choose a base branch
from
+360 −13

Auto-disable MTP when weights are absent from checkpoint

33d04f8
Select commit
Loading
Failed to load commit list.
Sign in for the full log view
Draft

Add MTP speculative decoding for DeepSeek-V4 #15

Auto-disable MTP when weights are absent from checkpoint
33d04f8
Select commit
Loading
Failed to load commit list.
Job log options

This job was skipped