You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
{{ message }}
Repository navigation
[Feature] Integrate Lightning SM90 Implementation via CuTe DSL #76
[Feature] Integrate Lightning SM90 Implementation via CuTe DSL
Background
FlashInfer has a production-ready Lightning Attention SM90 (Hopper) implementation. For API completeness, we could port it into cuLA using CuTe DSL, along with corresponding benchmarks and unit tests.
Note: The kernel design and algorithm credits belong to the original authors (guangyunh-nv). This issue tracks a porting effort, not an original implementation.
Upstream Implementation Overview
FlashInfer PR #2276 implements Lightning Attention Prefill on Hopper architecture:
SM90 Optimized: TMA warp-specialized architecture with asynchronous copy and warp group scheduling
Optional gating and final-state output
High-level Python API with chunked prefill support
Task Checklist
Port kernels via CuTe DSL: Rewrite the upstream C++ Hopper lightning kernels using CuTe DSL, following cuLA's build system and coding conventions
Adapt Python interface: Align with cuLA's existing API style and expose the Lightning SM90 Python bindings
Add benchmarks: Add performance benchmarks under cuLA's framework, covering the same settings as the KDA benchmarks:
Performance validation: Verify that the CuTe DSL version achieves comparable performance to the upstream C++ version across all benchmark settings above
Add unit tests: Port the reference implementation and test cases from upstream tests/gdn/ to ensure correctness
Update documentation: Document the newly added Lightning SM90 support
I think we should update this issue body to Gated Delta Net (GDN), since the linked FlashInfer #2276 and the related cuLA PR are both about GDN rather than Lightning Attention.
We should open a separate issue for the Lightning Attention SM90 CuTe DSL implementation, so the scope and upstream references remain clear. I’m interested in working on the Lightning Attention implementation.
Activity
Aharrypotter commentedon May 22, 2026
I'd like to take this. I've been studying #2276's C++ collective mainloop closely.
I'll open a draft PR this week. Please assign it to me.
zheyang0825 commentedon May 22, 2026
Assigned to you. Thanks for volunteering!
If you run into any questions or need clarification while working on this, feel free to ask here. Looking forward to your PR.
Aharrypotter commentedon Jul 20, 2026
I think we should update this issue body to Gated Delta Net (GDN), since the linked FlashInfer #2276 and the related cuLA PR are both about GDN rather than Lightning Attention.
We should open a separate issue for the Lightning Attention SM90 CuTe DSL implementation, so the scope and upstream references remain clear. I’m interested in working on the Lightning Attention implementation.