Skip to content

Update Attention Backends#62

Merged
kbumsik merged 33 commits into
deepauto/devfrom
feat/delta
May 19, 2025
Merged

Update Attention Backends#62
kbumsik merged 33 commits into
deepauto/devfrom
feat/delta

Conversation

@gmlwns2000

Copy link
Copy Markdown
Collaborator

This PR mainly updates the hip attention backend for SGlang.

  • Performance tuning.
  • Bugfixes.
  • New experimental features.

@kbumsik kbumsik left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@gmlwns2000 Thank you for your hard work!

Let's make the linter happy in the next PRs

@kbumsik kbumsik merged commit 3974c55 into deepauto/dev May 19, 2025
1 check failed
@kbumsik kbumsik deleted the feat/delta branch May 19, 2025 11:08
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants