ardanlabs/kronk

ardanlabs/kronk 是一个 SDK 与模型服务器，可在 Go 应用中调用本地模型，并通过多种兼容 API 对外提供。

GitHub 项目说明: Go With Your Own Intelligence! Use Go for hardware accelerated local inference with llama.cpp, whisper.cpp, and stable-diffusion.cpp directly integrated into your Go applications. Kronk provides a high-level API and production ready model server.