test(functional): add MoE performance recipe proxies#4726
Conversation
f5b7d87 to
377dcf2
Compare
|
/ok to test 377dcf2 |
377dcf2 to
41f84e8
Compare
|
/ok to test 41f84e8 |
Signed-off-by: yaoyu-33 <yaoyu.094@gmail.com>
41f84e8 to
6c63214
Compare
|
/ok to test 6c63214 |
|
Implementation and independent review are complete. The latest CI run is waiting at the protected |
Signed-off-by: yaoyu-33 <yaoyu.094@gmail.com>
|
/ok to test a46fa53 |
|
The updated three-model matrix is ready on commit a46fa53. Lint and pre-flight passed; the current functional run is waiting for approval on the protected test environment: https://github.com/NVIDIA-NeMo/Megatron-Bridge/actions/runs/28920614465 This run contains one GB200 x8 L0 job for Qwen3, GPT-OSS 120B, and DeepSeek V3 plus the existing H100 Qwen proxy. CI-maintainer approval is requested for the targeted x8 jobs described in the PR body. |
|
Superseded by #4742. The replacement uses an upstream branch and splits Qwen3, DeepSeek V3, and GPT-OSS 120B into independent model-specific L0 modules and launchers. |
What does this PR do?
Adds reduced, single-node functional proxies for the production Qwen3 30B-A3B, DeepSeek V3, and GPT-OSS 120B performance recipes. These three model families were implicated by the same downstream Blackwell MXFP8 grouped-MLP failure, but the existing Bridge functional suite did not exercise their production HybridEP and TE op-fuser paths.
This PR is intentionally stacked on #4679. The proxies therefore execute and guard the corrected natural-routing path. Retarget to main after #4679 merges.
Coverage
Why this matrix
A Qwen-only proxy guards the shared grouped-MLP operator path, but it cannot cover DeepSeek MTP/pipeline assembly or the GPT-OSS 120B provider and expert topology. Those differences were present in the downstream failures and are not represented by the current DeepSeek PP1/FSDP proxy or GPT-OSS 20B EP1 L1 test.
Other downstream failure classes were intentionally not converted into expensive GPU jobs: Llama packed-recipe construction is already enumerated by the dedicated recipe unit regression plus packed-LoRA functional coverage, while evaluator, performance-threshold, golden-data, and infrastructure failures belong in their respective test layers.
Validation
Full H100/GB200 runtime validation is delegated to this PR functional CI.
CI resource note
These tests are L0 because the objective is PR-time failure detection. They request eight GPUs, which is supported by the dynamic runner matrix but exceeds the general two-GPU guidance in CONTRIBUTING.md; automation/CI-maintainer approval is requested for this targeted exception.