New
ovg-project/kvcached v0.1.6 — Elastic KV cache for shared GPUs
ovg-project/kvcached v0.1.6 is a KV cache daemon that allocates GPU memory elastically to support LLM serving and training in shared environments.
Projects
ovg-project/kvcached
Virtualized Elastic KV Cache for Dynamic GPU Sharing and Beyond
View on GitHub ↗- stars
- ★ 1.8K
- Forks
- 216
- Language
- Python
- License
- Apache-2.0
- Latest release
- v0.1.6
Posts
1No matching stories.