Projects

niko1221/strata

Qwen3.8-Flash-Next on any consumer hardware: one-click install for Windows / Linux. Strata inference engine, OpenAI/Anthropic API on localhost, optional image input.

View on GitHub ↗

stars: ★ 26.7K
Forks: 2.8K
Language: C++
License: MIT
Latest release: v0.1.45

Posts

ReleaseOCT 17

niko1221/strata v0.1.45 — Qwen3.6 image input and concurrent requests

niko1221/strata v0.1.45 adds image input support for Qwen3.6-35B-A3B and handles up to 8 concurrent requests, with performance gains that vary depending on available VRAM.

niko1221/strata Inference & servingC++v0.1.45

ReleaseOCT 16

Niko1221/Strata v0.1.44.1 — Legacy CPU SIGILL hotfix

Strata v0.1.44.1 fixes SIGILL errors on older CPUs, build problems, and the server's crash retry behavior.

niko1221/strata Inference & servingC++v0.1.44.1