Devotd Github
ReleaseInference & serving

mw00/project-maya v1.1.41 — Improved multi-GPU prompt processing

mw00/project-maya, which runs large MoE models on user GPUs, added improved multi-GPU prompt processing and an agent loop-prevention feature in v1.1.41.

Repositorymw00/project-maya ↗

mw00/project-maya, which runs large MoE models on user GPUs, added improved multi-GPU prompt processing and an agent loop-prevention feature in v1.1.41.

GitHub description: Project Maya - run GLM-5.3-Flash (321B MoE), DeepSeek-V4.1-Flash-1017 (748B MoE) and MiniMax-M3.1-Flash (428B MoE) privately on your own GPU(s), from one card to 16, NVIDIA or AMD, Linux or Windows. Engine, server, dashboard, OpenAI- and Anthropic-compatible API, quant tools.

stars
★ 2.3K
Forks
301
Language
Cuda
License
MIT
Latest release
v1.1.41
Read original source ↗View on GitHub ↗

mw00/project-maya released v1.1.41. It is a project built to run GLM-5.3-Flash (321B MoE), DeepSeek-V4.1-Flash-1017 (748B MoE) and MiniMax-M3.1-Flash (428B MoE) on the user's own GPU. This release includes 36 community contributions. According to the release notes, in multi-GPU environments the speed of reading the first long prompt right after startup is about 1.3x faster.

Beyond the model execution engine, the project also provides a server, a dashboard, OpenAI- and Anthropic-compatible APIs and quantization tools. It says it supports one to sixteen NVIDIA or AMD GPUs along with Linux and Windows. So the components needed to run models can be reviewed in a single repository, and setups that use the compatible APIs are an option as well. The release notes add that speed improved even on PCs with insufficient memory.

v1.1.41 also added an agent loop-prevention mechanism that keeps working even after turns change. However, the release description does not state the measurement environment or comparison baseline for the roughly 1.3x improvement. This figure can be seen as a result reported by the release, but no evidence is given to conclude that the same improvement occurs in other environments.