ipads-sai/mobiinfer-android

MobiInfer runs 35B-A3B-class MoE models fully on-device on the Qualcomm Hexagon NPU, streaming experts from flash with lookahead scheduling (LES) and DSpark speculation.

星标

★ 16

复刻

1

语言

C++

许可证

MIT

最新版本

v0.1-alpha