New
jakeatx/llamampere v0.6.2.2 — PLE Prefetch Disabled by Default
In v0.6.2.2, jakeatx/llamampere removed the launcher's forced PLE prompt prefetch, and the commit message states that reading a 100K-token prompt became approximately 30~45% faster.
jakeatx/llamampere
In v0.6.2.2, jakeatx/llamampere removed the launcher's forced PLE prompt prefetch, and the commit message states that reading a 100K-token prompt became approximately 30~45% faster.
View on GitHub ↗- stars
- ★ 178
- Forks
- 20
- Language
- C++
- License
- MIT
- Latest release
- v0.5.5
Posts
1No matching stories.