New
zhulinsen/litemoe — a small MoE inference engine
zhulinsen/litemoe is a Python-based MoE engine that builds the inference flow itself while reusing some vLLM kernels.
zhulinsen/litemoe
zhulinsen/litemoe is a Python-based MoE engine that builds the inference flow itself while reusing some vLLM kernels.
View on GitHub ↗- stars
- ★ 2
- Forks
- 0
- Language
- Python
- License
- Apache-2.0
Posts
1No matching stories.