defai-digital/ax-engine

defai-digital/ax-engine 是一个在 Apple Silicon 上提供多种语言模型的运行时环境，其最新版本是 v7.8.0。

GitHub 项目说明: One Mac process. Many models. Real speed. Multi-model LLM serving with prefix reuse, MTP acceleration, and OpenAI APIs — built for Apple Silicon, measured against mlx-lm and llama.cpp.

星标

★ 32

复刻

2

语言

Rust

许可证

Apache-2.0

最新版本

v7.8.0