cosmonomic/pulsarlm

An LLM inference engine for persistent chat bots and agents. It allows models to forget old and unimportant tokens to keep context small and inference fast.

스타

★ 4

포크

0

언어

C++

라이선스

Apache-2.0

최신 릴리스

—