Devotd Github

luce-org/lucebox

Commits adding a late-expert option that reduces per-layer kernel launches on the target GPU from 45.4 to about 36 in two-GPU split decoding, plus additional CUDA·HIP fusions.

View on GitHub ↗
stars
★ 2.9K
Forks
287
Language
C++
License
Apache-2.0

Posts

1