New
b4rtaz/distributed-llama v0.16.5 — A distributed inference engine that pools home devices
b4rtaz/distributed-llama is a C++ engine that ties home PCs and Raspberry Pi together over Ethernet to run LLM inference in a distributed fashion using tensor parallelism; the latest release on GitHub is v0.16.5.