penta2himajin/qwisp is a server and CLI that performs local inference of Qwen3.6-35B-A3B on Apple Silicon. It runs the MoE (Mixture of Experts: a structure that activates only the modules matching the condition in order to reduce computation) on Seedless, a Metal decoding engine built on top of MLX, and its request format is compatible with the OpenAI API. Commit 05e745b, which entered the repository on October 6, 2026, plugged this compatibility gap. If you put stream_options with include_usage set to true into a streaming request, a usage object now goes out in the final chunk just before [DONE] is sent.
Until now, usage information was included only in non-streaming responses, so clients receiving responses by streaming had to take completion_tokens=0 as it came. That is because streaming responses arrive via SSE (Server-Sent Events, a format in which the server sends text events one after another). The server flows one additional chunk with empty choices just before sending [DONE], and it carries only prompt_tokens, completion_tokens, and total_tokens there. The values come from the number of prompt and generated token IDs that the engine is counting. In the same commit, StreamOptions was added to the request struct, so stream_options, which used to be discarded as an unknown key at the JSON decoding stage, is now preserved. A single line confirming that round trip was also added to the self-test.
That said, the evidence is limited to this one commit. The change is only 24 added lines spanning three files under swift/Sources/qwisp, with no deletions. Because the usage figures are a direct export of the server's own token counts, they are not values cross-checked against a separate counter. Release tags, deployment forms, and performance measurements are not presented in this record, so the breadth of compatibility with other clients and the effect on speed are premature to judge. There is one conspicuous improvement point. If you attach an OpenAI-spec streaming client, the usage accounting definitively changes from 0 to the actual value.