Devotd Github

yibie/strata-mlx

yibie/strata-mlx now enables conversation parking by default and keeps requests under 256 tokens from occupying a slot, changing the default behavior of re-reading the long prompt after another client's request.

View on GitHub ↗
stars
★ 97
Forks
15
Language
Python
License
MIT

Posts

1