Release
sgl-project/sglang v0.5.22 — Model support and serving changes
sgl-project/sglang v0.5.22 is a release that brings new model support, model loading changes, disaggregated prefill/decode placement, and an expanded scope for sparse attention.
Projects
sgl-project/sglang
SGLang is a high-performance serving framework for large language models and multimodal models.
View on GitHub ↗- stars
- ★ 37.3K
- Forks
- 9.7K
- Language
- Python
- License
- Apache-2.0
- Latest release
- v0.5.22
Posts
1No matching stories.