New
fronteagle739/streaming-llama-stack — NVMe Weight-Streaming Inference Stack
Introduces an experimental C-language stack that bundles NVMe weight streaming with inference tools, based on a llama.cpp fork.
fronteagle739/streaming-llama-stack
Introduces an experimental C-language stack that bundles NVMe weight streaming with inference tools, based on a llama.cpp fork.
View on GitHub ↗- stars
- ★ 6
- Forks
- 0
- Language
- C
- License
- MIT
Posts
1No matching stories.