feat(attention): Add attention_per_head_gate and rotary_base_per_laye…#4473

Open

shifangx wants to merge 2 commits intoNVIDIA:devfrom

shifangx:shifang/attention-for-step-3.5-flash

Commits on Apr 26, 2026

feat(attention): Add attention_per_head_gate and rotary_base_per_layer for Step-3.5-Flash

authored and
shifangx
committed
add test
shifangx
committed