New
seuros/mdma — a Rust inference engine with seven backends
Introduces seuros/mdma's seven hardware backends, its memory management and kernel verification structure, and its experimental status.
Projects
seuros/mdma
Model Dispatch and Memory Allocator: an LLM inference engine for the hardware you own. Custom CPU, ROCm, Vulkan, CUDA, Metal and Level Zero kernels, exact memory admission, mTLS gRPC and private federation.
View on GitHub ↗- stars
- ★ 14
- Forks
- 4
- Language
- Rust
- License
- BSD-2-Clause
- Latest release
- —
Posts
1No matching stories.