mattral/flashspec-asm

mattral/flashspec-asm is an optional AVX2 CPU path for computing the residual probability distribution in speculative decoding.

stars

★ 9

Forks

0

Language

C

License

Apache-2.0

Latest release

v0.1.2