penta2himajin/qwisp

The local MoE inference server qwisp for Apple Silicon has been changed so that streaming responses carry usage information in their final chunk.

stars

★ 16

Forks

1

Language

Swift

License

Apache-2.0

Latest release

v0.3.11