github.devotd.
Projects

ixmxamar/sageattention-rdna4

Quantized attention for AMD RX 9070 / 9070 XT (RDNA4, gfx1201): a hand-written HIP attention kernel behind SageAttention, serving the fused q/k/v views video models send, at 0.87-0.94x PR #368's time over production sizes.

View on GitHub ↗
stars
★ 13
Forks
1
Language
Python
License
Apache-2.0
Latest release
v0.4.0

Posts

1