Zero train-gen mismatch with megatron inference#3208

YigongQin wants to merge 4 commits into

NVIDIA-NeMo:mainNVIDIA-NeMo/RL:mainfrom

YigongQin:yigongq/minf-onpolicyYigongQin/RL:yigongq/minf-onpolicyCopy head branch name to clipboard