New
modelcloud/gptqmodel v7.6.0 — a quantization toolkit for GPU and CPU
modelcloud/gptqmodel is a Python toolkit that quantizes LLM weights to a low bit width to provide GPU- and CPU-accelerated inference, and its latest release is v7.6.0.
modelcloud/gptqmodel
modelcloud/gptqmodel is a Python toolkit that quantizes LLM weights to a low bit width to provide GPU- and CPU-accelerated inference, and its latest release is v7.6.0.
View on GitHub ↗- stars
- ★ 1.3K
- Forks
- 211
- Language
- Python
- License
- NOASSERTION
- Latest release
- v7.6.0
Posts
1No matching stories.