-
-
Notifications
You must be signed in to change notification settings - Fork 13.8k
Open
Labels
feature requestNew feature or requestNew feature or requestrocmRelated to AMD ROCmRelated to AMD ROCm
Description
🚀 The feature, motivation and pitch
hi @powderluv @chunfangamd @andyluo7
AMD only have MXFP4 checkpoints of MiniMax M2.1 but doesnt have MXFP4 checkpoints of the latest MiniMax M2.5 model
MiniMax M2.5 is the same architecture as MiniMax M2.1 but different weights. It would be great to have an MXFP4 ckpt of MiniMax M2.5 since M2.5 is way more popularity used than M2.1
We see great performance boost from MXFP4 compared to FP8 on the MiniMax architecture
Alternatives
use fp8 and get worse perf
Additional context
No response
Before submitting a new issue...
- Make sure you already searched for relevant issues, and asked the chatbot living at the bottom right corner of the documentation page, which can answer lots of frequently asked questions.
Reactions are currently unavailable
Metadata
Metadata
Assignees
Labels
feature requestNew feature or requestNew feature or requestrocmRelated to AMD ROCmRelated to AMD ROCm
Type
Projects
Status
Todo