New
vllm-project/llm-compressor 0.14.0 — a model compression library for vLLM
Introduces the documented model compression and quantization features of vllm-project/llm-compressor 0.14.0, and the scope that can actually be confirmed.
Projects
vllm-project/llm-compressor
State-of-the-art LLM compression, built for production inference with vLLM
View on GitHub ↗- stars
- ★ 3.9K
- Forks
- 699
- Language
- Python
- License
- Apache-2.0
- Latest release
- 0.14.0
Posts
1No matching stories.