Skip to content

Incompatibility with transformers>=5.x #119

@duyddwcs

Description

@duyddwcs

Hi @ChenFengYe , I found that MotionGPT works correctly with transformers==4.57.1, but when upgrading to transformers==5.3.0, the model still runs but produces clearly wrong motion outputs with no runtime error.

The only noticeable difference is an additional warning about weight tying (shared.weight vs lm_head.weight) when loading the T5 model in v5.x, which does not appear in v4.x.

It might be helpful to specify the compatible transformers version in the requirements, so others don’t run into the same issue.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions