Skip to content

Support flash-attn kernel support for non-Hopper GPUs #12308

@ParagEkbote

Description

@ParagEkbote

Is your feature request related to a problem? Please describe.
In #12236 , flash-attn-3 support was introduced for diffusers using the kernel implementation. I believe that adding the kernels-community/flash-attn can help users who don't have access to Hopper GPUs. If needed, I could help in the integration of the kernel.

cc: @sayakpaul

Describe the solution you'd like.

Integrate kernels-community/flash-attn support into diffusers.

Metadata

Metadata

Assignees

No one assigned

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions