Add zloss and partial weight decay#136

daviswer wants to merge 4 commits intomamba-newfoundation-model-stack/fms-fsdp:mamba-newfrom

mamba-new-zlwdfoundation-model-stack/fms-fsdp:mamba-new-zlwdCopy head branch name to clipboard