github.devotd.

Multimodal Runtime Inference

Reusable execution engines primarily specialized for image, audio, video, vision-language, or combined multimodal models. Complete-engine deployment and hardware precedence defined by llm-inference applies first. Excludes model releases, training tools, end-user media workflows, and general engines with incidental multimodal support.

Projects in this field (2)
ProjectWhat it doesStarsLanguageLicenseLatest release
flashml-org/freevideoA local inference engine efficiently runs the MiniMax H3 video model on consumer GPUs.★ 2.1KPythonApache-2.0v0.4.14
nyosegawa/speech.cppRuns speech synthesis, recognition, and VAD models across multiple hardware backends using ggml.★ 180C++MITv0.8.10