New
justvugg/colibri v2.0.0 — A pure-C MoE engine with disk streaming
justvugg/colibri v2.0.0 is a pure-C inference engine that loads only the needed experts into memory and reads the rest from disk, so it can run MoE models with hundreds of billions of parameters on an 8GB memory machine.