New
kvcache-ai/ktransformers v0.7.2 — a heterogeneous CPU·GPU computing inference framework
kvcache-ai/ktransformers is a framework for researching large language model inference and fine-tuning by using CPUs and GPUs together.
kvcache-ai/ktransformers
kvcache-ai/ktransformers is a framework for researching large language model inference and fine-tuning by using CPUs and GPUs together.
View on GitHub ↗- stars
- ★ 19.6K
- Forks
- 1.6K
- Language
- Python
- License
- Apache-2.0
- Latest release
- v0.7.2
Posts
1No matching stories.