github.devotd.

gpustack/gpustack

GPUStack is an Apache-2.0 open-source manager that manages GPU clusters across on-premise servers, Kubernetes, and the cloud, providing vLLM- and SGLang-based model serving along with GPU instances you can access over SSH; the latest release is v2.2.3.

View on GitHub ↗
stars
★ 5.9K
Forks
692
Language
Python
License
Apache-2.0
Latest release
v2.2.3

Posts

1