New
a775828b-dot/xtier — a CPU/GPU hybrid MoE plugin for SGLang
a775828b-dot/xtier is an SGLang plugin that splits mixture-of-experts inference across CPU and GPU memory and reads some embedding rows from storage.
a775828b-dot/xtier
a775828b-dot/xtier is an SGLang plugin that splits mixture-of-experts inference across CPU and GPU memory and reads some embedding rows from storage.
View on GitHub ↗- stars
- ★ 6
- Forks
- 1
- Language
- Python
- License
- Apache-2.0
Posts
1No matching stories.