Skip to content

Conversation

entrpn
Copy link
Collaborator

@entrpn entrpn commented Sep 19, 2025

Copy link

coolkp
coolkp previously approved these changes Sep 22, 2025
@entrpn
Copy link
Collaborator Author

entrpn commented Sep 22, 2025

Just realized that I also need to support ring with these new axis rules. If attention=ring, then force logical axis rules to change in pyconfig such that ring attention is supported.

@coolkp coolkp force-pushed the cross_self_attention_switch branch 13 times, most recently from 878f045 to fc17634 Compare September 26, 2025 21:07
@coolkp coolkp force-pushed the cross_self_attention_switch branch from fc17634 to 65da062 Compare October 10, 2025 19:10
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants