New
eelgaev/legion — a Rust MoE inference engine for unified memory
eelgaev/legion is a Rust inference engine that runs MoE models on NVIDIA unified memory systems and handles GGUF and safetensors weights.
eelgaev/legion
eelgaev/legion is a Rust inference engine that runs MoE models on NVIDIA unified memory systems and handles GGUF and safetensors weights.
View on GitHub ↗- stars
- ★ 4
- Forks
- 0
- Language
- Rust
- License
- Apache-2.0
Posts
1No matching stories.