Devotd Github

carloslfu/slotstream

carloslfu/slotstream 于 2026 年 10 月 25 日的提交记录了 Q2 验证测量,并回滚了直接预测读取候选。

GitHub 项目说明: Run a 105 GB AI model on a Mac that can't hold it. Slotstream streams Qwen3.8-Flash-Next (125B mixture of experts) from your SSD and caches the busiest experts in memory, so it runs on Macs with 16 to 64 GB. One native Swift binary on MLX and Metal, no Python, offline. Works with Claude Code, Codex and Ollama or OpenAI clients.

在 GitHub 查看 ↗
星标
★ 474
复刻
37
语言
Swift
许可证
MIT
最新版本
v0.2.29

文章

1