New
cosmonomic/pulsarlm — an LLM inference engine for persistent conversations
cosmonomic/pulsarlm is an LLM inference engine that manages context in persistent conversations by dropping low-importance tokens.
Projects
cosmonomic/pulsarlm
An LLM inference engine for persistent chat bots and agents. It allows models to forget old and unimportant tokens to keep context small and inference fast.
View on GitHub ↗- stars
- ★ 4
- Forks
- 0
- Language
- C++
- License
- Apache-2.0
- Latest release
- —
Posts
1No matching stories.