New
ewhacc/tandem.cpp — Running Mixture-of-Experts Models on llama.cpp
ewhacc/tandem.cpp is a project that patches llama.cpp to run mixture-of-experts models that do not fit entirely in GPU memory.
ewhacc/tandem.cpp
ewhacc/tandem.cpp is a project that patches llama.cpp to run mixture-of-experts models that do not fit entirely in GPU memory.
View on GitHub ↗- stars
- ★ 3
- Forks
- 0
- Language
- Python
- License
- NOASSERTION
Posts
1No matching stories.