New
flashml-org/freetoken v0.1.3 — a MoE serving engine for desktops
An introduction to what flashml-org/freetoken offers for serving large MoE models on edge hardware, and to the limits of its performance information.
Projects
flashml-org/freetoken
FreeToken brings datacenter-scale model serving to your desktop. Run massive models locally, fast and efficiently.
View on GitHub ↗- stars
- ★ 14.6K
- Forks
- 1.5K
- Language
- Python
- License
- Apache-2.0
- Latest release
- v0.1.3
Posts
1No matching stories.