New
alleyxd/quantpicker v0.1.0 — Measured GGUF Quantization Selection for GPUs
alleyxd/quantpicker v0.1.0 is a command-line tool that measures the speed and quality loss of GGUF quantization candidates on a GPU to pick which one to run.
alleyxd/quantpicker
alleyxd/quantpicker v0.1.0 is a command-line tool that measures the speed and quality loss of GGUF quantization candidates on a GPU to pick which one to run.
View on GitHub ↗- stars
- ★ 15
- Forks
- 0
- Language
- Rust
- License
- MIT
- Latest release
- v0.1.0
Posts
1No matching stories.