New
jundot/omlx v0.7.1rc1 — Local Inference Server for Apple Silicon
jundot/omlx is a local inference server that runs LLMs on Apple Silicon and is managed through a macOS menu bar app.
Projects
jundot/omlx
LLM inference server with continuous batching & SSD caching for Apple Silicon — managed from the macOS menu bar
View on GitHub ↗- stars
- ★ 22.9K
- Forks
- 2.1K
- Language
- Python
- License
- Apache-2.0
- Latest release
- v0.7.1rc1
Posts
1No matching stories.