Multimodal Runtime Inference
Reusable execution engines primarily specialized for image, audio, video, vision-language, or combined multimodal models. Complete-engine deployment and hardware precedence defined by llm-inference applies first. Excludes model releases, training tools, end-user media workflows, and general engines with incidental multimodal support.
| Project | What it does | Stars | Language | License | Latest release |
|---|---|---|---|---|---|
| flashml-org/freevideo | A local inference engine efficiently runs the MiniMax H3 video model on consumer GPUs. | ★ 2.1K | Python | Apache-2.0 | v0.4.14 |
| nyosegawa/speech.cpp | Runs speech synthesis, recognition, and VAD models across multiple hardware backends using ggml. | ★ 180 | C++ | MIT | v0.8.10 |