Skip to content

Conversation

luanyundu
Copy link
Contributor

Adapt v2 interface and padding

int64_t expert_shard_type = 0;
int64_t expert_token_nums_type = 1;
int64_t global_bs = num_max_dispatch_tokens_per_rank * num_ranks;
int64_t shared_expert_rank_num = 0;
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

whether the value shared_expert_rank_num must be 0

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants