New
kekzl/imp — A C++23 LLM Server for Blackwell
kekzl/imp is an LLM server targeting a single NVIDIA Blackwell GPU that provides an API, model input formats, and published performance measurements.
kekzl/imp
kekzl/imp is an LLM server targeting a single NVIDIA Blackwell GPU that provides an API, model input formats, and published performance measurements.
View on GitHub ↗- stars
- ★ 48
- Forks
- 4
- Language
- C++
- License
- MIT
- Latest release
- v0.59.2
Posts
1No matching stories.