seuros/mdma

Model Dispatch and Memory Allocator: an LLM inference engine for the hardware you own. Custom CPU, ROCm, Vulkan, CUDA, Metal and Level Zero kernels, exact memory admission, mTLS gRPC and private federation.

星标

★ 14

复刻

4

语言

Rust

许可证

BSD-2-Clause

最新版本

—