New
wici-ai/inferssd — an MoE inference engine built on SSD streaming
Introduces the SSD streaming approach of InferSSD, which is built on llama.cpp, along with the models and access methods listed in the README.
wici-ai/inferssd
Introduces the SSD streaming approach of InferSSD, which is built on llama.cpp, along with the models and access methods listed in the README.
View on GitHub ↗- stars
- ★ 160
- Forks
- 27
- Language
- C++
- License
- Apache-2.0
- Latest release
- v0.1.1
Posts
1No matching stories.