Devotd Github
NewInference & serving

asf0/libstrix — HIP Kernels and vLLM Plugin for Strix Halo

asf0/libstrix is a repository that provides HIP kernels for AMD Strix Halo and applies them selectively through an upstream vLLM plugin.

Repositoryasf0/libstrix ↗

asf0/libstrix is a repository that provides HIP kernels for AMD Strix Halo and applies them selectively through an upstream vLLM plugin.

GitHub description: HIP kernels for AMD Strix Halo (gfx1151) and a vLLM plugin that runs them on stock upstream vLLM: up to 31x faster prefill and ~2x decode at long context.

stars
★ 3
Forks
0
Language
Python
License
MIT
Read original source ↗View on GitHub ↗

asf0/libstrix provides HIP kernels for AMD Strix Halo (gfx1151, Radeon 8060S) along with a plugin that uses them in upstream vLLM. The kernels are applied through the plugin without modifying vLLM sources, and they do not activate on other graphics devices. The repository description states that in long-context scenarios prefill is up to 31x faster and decode about 2x faster.

Each kernel is compiled for a single operation geometry. The strix.select call is a feature for checking which geometries a kernel supports; if the input geometry or dtype conditions do not match, that kernel is not used and vLLM's default path is used instead. So the design is not to apply kernels to every input, but to select them only when the support conditions are met. The README documents a kernel registry and the selection feature, as well as test code and benchmark configuration. The repository's primary implementation language is Python and its license is MIT.

The performance figures presented have not been independently reproduced using only the repository's own materials, so it is difficult to treat them as conclusive evidence of actual performance. The applicable target is also limited to Strix Halo and the supported geometry and dtype conditions. The performance claims should therefore be treated as repository-side results that need further verification, while also taking into account the narrow scope of applicability.