andrei-borcea/liyab

🔥 Run large open language models on your phone. A C++20 GGUF inference engine that streams models larger than RAM from flash, paces itself by the device's thermal forecast, and powers a private on-device assistant. Android · iOS · macOS · Linux.

星标

★ 7

复刻

0

语言

C++

许可证

Apache-2.0

最新版本

—