New
athrael-soju/narwhal 0.8.0 — operator visibility and prefill recovery
athrael-soju/narwhal, a Python project that handles LLM inference by splitting it into prefill and decode in a role-free fleet, released version 0.8.0.
athrael-soju/narwhal
athrael-soju/narwhal, a Python project that handles LLM inference by splitting it into prefill and decode in a role-free fleet, released version 0.8.0.
View on GitHub ↗- stars
- ★ 8
- Forks
- 2
- Language
- Python
- License
- Apache-2.0
- Latest release
- v0.7.0
Posts
1No matching stories.