New
waybarrios/vllm-mlx — MLX Inference Server for Apple Silicon
Looks at the features of the waybarrios/vllm-mlx inference server for Apple Silicon and at the limits of the performance figures given in its documentation.
waybarrios/vllm-mlx
Looks at the features of the waybarrios/vllm-mlx inference server for Apple Silicon and at the limits of the performance figures given in its documentation.
View on GitHub ↗- stars
- ★ 1.6K
- Forks
- 233
- Language
- Python
- License
- Apache-2.0
- Latest release
- v0.6.0
Posts
1No matching stories.