Devotd Github
ReleaseInference & serving

prabanta-dev/janas v2026.10.29.1 — Binaries and GPU diagnostic build

prabanta-dev/janas released the v2026.10.29.1 patch, providing Linux and Windows binaries along with a graphics processing unit (GPU) diagnostic build.

Repositoryprabanta-dev/janas ↗

prabanta-dev/janas released the v2026.10.29.1 patch, providing Linux and Windows binaries along with a graphics processing unit (GPU) diagnostic build.

GitHub description: 37 tok/s from Qwen3-Next-80B (48 GB) on a 32 GB laptop, 24 without drafts vs 2.8 for llama.cpp; reading 62 vs 16 tok/s. Faster than llama.cpp on all 13 models compared in Q4_K_M. LLMs bigger than your RAM, pure C, CPU or GPU.

stars
★ 477
Forks
37
Language
C
License
GPL-3.0
Latest release
v2026.10.29.1
Read original source ↗View on GitHub ↗

prabanta-dev/janas is a pure C project for running language models larger than RAM on a CPU or GPU. According to the GitHub release page, v2026.10.29.1 is a patch release following the previous day's release. This release includes Linux and Windows binaries and a graphics processing unit (GPU) diagnostic build. The changes are summarized in the repository's ChangeLog.md, but the provided information lists no specific fix items.

The repository description presents running models larger than memory and performance comparisons. The example given in the description is that running the 48 GB Qwen3-Next-80B on a 32 GB laptop recorded 37 tok/s. The case without draft is 24 tok/s, and llama.cpp is listed at 2.8 tok/s. Read speeds are 62 tok/s and 16 tok/s respectively. It also states that it is faster than llama.cpp for all 13 models compared in Q4_K_M format.

These figures and comparison results are claims recorded in the repository description. The provided material contains no measurement conditions or independent verification results. Therefore, the change that can be confirmed in this release is the availability of binaries for each platform and the GPU diagnostic build, and the performance advantage is best treated as a repository claim until separate supporting evidence is confirmed.