Skip to content

Conversation

entrpn
Copy link
Collaborator

@entrpn entrpn commented Sep 19, 2025

Copy link

coolkp
coolkp previously approved these changes Sep 22, 2025
@entrpn
Copy link
Collaborator Author

entrpn commented Sep 22, 2025

Just realized that I also need to support ring with these new axis rules. If attention=ring, then force logical axis rules to change in pyconfig such that ring attention is supported.

@coolkp coolkp force-pushed the cross_self_attention_switch branch 12 times, most recently from 68aa939 to 878f045 Compare September 26, 2025 21:04
@coolkp coolkp force-pushed the cross_self_attention_switch branch from 878f045 to fc17634 Compare September 26, 2025 21:07
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants