the MoE Expert CPU offload (EP, expert parallel) is introduced in #130, with argument --num-experts-offload-per-rank for use
then in #203 it changed to environment variable NUM_EXPERTS_OFFLOAD_PER_RANK
then in #403, a big refactor let the feature not available anymore
ref: guoqingbao/xinfer#161
the MoE Expert CPU offload (EP, expert parallel) is introduced in #130, with argument
--num-experts-offload-per-rankfor usethen in #203 it changed to environment variable
NUM_EXPERTS_OFFLOAD_PER_RANKthen in #403, a big refactor let the feature not available anymore
ref: guoqingbao/xinfer#161