New
srikanthbalaaji/dimmer-kv — Per-token precision KV cache compression
srikanthbalaaji/dimmer-kv is a project that compresses KV caches by lowering per-token precision and computes attention directly from the compressed cache.
srikanthbalaaji/dimmer-kv
srikanthbalaaji/dimmer-kv is a project that compresses KV caches by lowering per-token precision and computes attention directly from the compressed cache.
View on GitHub ↗- stars
- ★ 2
- Forks
- 0
- Language
- Python
- License
- MIT
Posts
1No matching stories.