gautam1858/banach

gautam1858/banach 是一个从 NVMe 读取并运行混合专家模型的 Rust 推理工具。

GitHub 项目说明: Runs everything, needed for the giants. Local LLM inference that fits 300B–3T Mixture-of-Experts models onto the machine you already own: exact weights on NVMe, a precision ladder in RAM, certified fidelity, honest predictions before you download.

星标

★ 6

复刻

0

语言

Rust

许可证

Apache-2.0

最新版本

v0.1.3