ardanlabs/kronk

ardanlabs/kronk는 Go 애플리케이션에서 로컬 모델을 호출하고 여러 호환 API로 제공하는 SDK와 모델 서버다.

GitHub 설명: Go With Your Own Intelligence! Use Go for hardware accelerated local inference with llama.cpp, whisper.cpp, and stable-diffusion.cpp directly integrated into your Go applications. Kronk provides a high-level API and production ready model server.