seuros/mdma

Model Dispatch and Memory Allocator: an LLM inference engine for the hardware you own. Custom CPU, ROCm, Vulkan, CUDA, Metal and Level Zero kernels, exact memory admission, mTLS gRPC and private federation.

스타

★ 14

포크

4

언어

Rust

라이선스

BSD-2-Clause

최신 릴리스

—