1115714829/llama.cpp-v100

整理面向 NVIDIA Tesla V100 的 llama.cpp 派生分支的支持范围与最新版本信息。

GitHub 项目说明: llama.cpp optimized for NVIDIA Tesla V100 (SM70): Qwen3.8-Flash-Next with MTP (prefill 3402 tok/s at 200K context on 6x V100-16GB; also runs on 2x V100-16GB) and Qwen3.8-27B with DFlash2 (decode up to 220 tok/s); 2-6 GPUs, 262K-512K context, multimodal, concurrent serving, built-in web UI.

星标

★ 61

复刻

13

语言

C++

许可证

GPL-3.0

最新版本

v100-2.0.1.1