New
valeriodolci/capy-flash v0.5.4 — NVFP4 MoE inference on two 16GB GPUs
Covers the Qwen3.8-Flash-Next inference setup in valeriodolci/capy-flash and the comparison figures against Strata published in its README.
Qwen3.8-Flash-Next (MoE, NVFP4) and Qwen3.8-27B on two 16 GB consumer GPUs: two-GPU tensor parallel, experts offloaded to CPU. Formerly ninfer-tp2.
View on GitHub ↗Covers the Qwen3.8-Flash-Next inference setup in valeriodolci/capy-flash and the comparison figures against Strata published in its README.
No matching stories.