New
blockwayz/agens-engine — Agens Volundr inference engine for consumer GPUs
blockwayz/agens-engine is a C++ inference engine that runs the Agens Volundr model on a single consumer graphics card and serves it through an OpenAI-compatible chat API.
blockwayz/agens-engine
blockwayz/agens-engine is a C++ inference engine that runs the Agens Volundr model on a single consumer graphics card and serves it through an OpenAI-compatible chat API.
View on GitHub ↗- stars
- ★ 7
- Forks
- 1
- Language
- C++
- License
- NOASSERTION
Posts
1No matching stories.