New
cipheraxat/nanoserve — A PyTorch-based vLLM-style inference engine
cipheraxat/nanoserve is a PyTorch inference engine that provides Qwen3, implementing caching and batching features along with an OpenAI-compatible server.
cipheraxat/nanoserve
cipheraxat/nanoserve is a PyTorch inference engine that provides Qwen3, implementing caching and batching features along with an OpenAI-compatible server.
View on GitHub ↗- stars
- ★ 2
- Forks
- 0
- Language
- Python
- License
- MIT
Posts
1No matching stories.