ipads-sai/mobiinfer-android

MobiInfer runs 35B-A3B-class MoE models fully on-device on the Qualcomm Hexagon NPU, streaming experts from flash with lookahead scheduling (LES) and DSpark speculation.

스타

★ 16

포크

1

언어

C++

라이선스

MIT

최신 릴리스

v0.1-alpha