Skip to content

Comments

[attention backends] fix ring CP for flash and flash 3#13182

Open
sayakpaul wants to merge 6 commits intomainfrom
cp-attn-backend-tests
Open

[attention backends] fix ring CP for flash and flash 3#13182
sayakpaul wants to merge 6 commits intomainfrom
cp-attn-backend-tests

Conversation

@sayakpaul
Copy link
Member

What does this PR do?

  • Fixes support for ring attention for Flash and Flash 3
  • Adds a test suite for CP backends x attention backends
image (CP x FA3) image (CP x FA2)

@sayakpaul sayakpaul requested a review from DN6 February 24, 2026 11:39
@HuggingFaceDocBuilderDev

The docs for this PR live here. All of your documentation changes will be reflected on that endpoint. The docs are available until 30 days after the last update.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants