Add preliminary Muon+M-FSDP support#4486

janEbert wants to merge 5 commits intoNVIDIA:mainNVIDIA/Megatron-LM:mainfrom

janEbert:muon-m-fsdpjanEbert/Megatron-LM:muon-m-fsdpCopy head branch name to clipboard