gautam1858/banach

gautam1858/banach は、NVMe から混合専門家モデルを読み込んで実行する Rust 製の推論ツールだ。

GitHub の説明: Runs everything, needed for the giants. Local LLM inference that fits 300B–3T Mixture-of-Experts models onto the machine you already own: exact weights on NVMe, a precision ladder in RAM, certified fidelity, honest predictions before you download.