New
ollama/ollama v0.40.5 — Local and cloud model runtime
ollama/ollama is a runtime server that runs open models locally or in the cloud and connects them to a range of tools.
CURATED OPEN SOURCE INTELLIGENCE
#local-ai
New
fesens/opentpu — An Open-Source AI Accelerator Designed by an AI Agent
fesens/opentpu is an open-source AI accelerator designed by an AI agent, gathering everything from hardware to compiler into one repository and presenting run results on a Kintex-7 card.
New
l-forster/open-jet v0.5.0 — Offline Agent and CUDA Inference Engine
l-forster/open-jet provides an offline coding agent for local models and a CUDA inference engine for Qwen3.8-27B; the latest release is v0.5.0.
New
indras-mirror/xolotl — a large MoE inference engine for a single GPU
Xolotl, a C++ engine that extends Strata, serves several large models through an OpenAI/Anthropic-compatible server, and its README reports a decode speed of 26.8 tok/s for DeepSeek-V4.1-Flash 552B on an RTX 4090.
Release
niko1221/strata v0.1.45 — Qwen3.6 image input and concurrent requests
niko1221/strata v0.1.45 adds image input support for Qwen3.6-35B-A3B and handles up to 8 concurrent requests, with performance gains that vary depending on available VRAM.
New
alexsjones/llmfit v1.1.17 — Model recommendations by hardware
alexsjones/llmfit v1.1.17 is a Rust command-line tool that recommends language models suited to your hardware and shares measured benchmarks.
Release
ggml-org/llama.cpp b11700 — Add Granite Switch decision converter
llama.cpp b11700 added decision conversion and support paths for Granite Switch family models.
New
sno-ai/sno-station v1.3.9 — agent squad harness
sno-ai/sno-station is a locally running harness that lets multiple coding agents share an encrypted memory and hand work back and forth.
Release
ggml-org/llama.cpp b11683 — Vulkan Host Memory Import Fixes
llama.cpp nightly b11683 is a build that fixes the Vulkan backend's host memory import failure logging and AMD's buffer sharing path.
New
antirez/ds4 — a local inference engine for Metal, CUDA, ROCm
antirez/ds4 is a C-based local inference engine that runs a set of models on Metal, CUDA, and ROCm.
Release
arahim3/digup v0.7.0-beta.1 — Windows and Linux support expansion
DigUp, which searches your computer based on the contents of photos, PDFs, documents, recordings, videos, and code, expanded to Windows and Linux for the first time in v0.7.0-beta.1.
New
magnitudedev/magnitude — a local inference engine tailored to the hardware
magnitudedev/magnitude is a Rust-based open-source engine that tunes kernels to the hardware and uses them for model inference.
Release
nousresearch/hermes-agent v0.22.2 — Fixes gateway startup issue
nousresearch/hermes-agent v0.22.2 is a release that replaces the faulty v0.22.1 build and fixes the gateway startup issue as well as retry behavior for local model conversations on laptops.
New
tigerless-labs/agent-memory — a Markdown-based long-term memory runtime for agents
Describes the Markdown storage approach and long-term agent memory retrieval structure of tigerless-labs/agent-memory.
New
flashml-org/freetoken v0.1.3 — a MoE serving engine for desktops
An introduction to what flashml-org/freetoken offers for serving large MoE models on edge hardware, and to the limits of its performance information.
Release
Niko1221/Strata v0.1.44.1 — Legacy CPU SIGILL hotfix
Strata v0.1.44.1 fixes SIGILL errors on older CPUs, build problems, and the server's crash retry behavior.
Release
ggml-org/llama.cpp b11630 — Daily Build Automated Release
ggml-org/llama.cpp b11630 is a daily build automated release whose changes are described only at the level of commit messages.
No matching stories.