New
yuhai-china/ds4-spark — Markov draft logit computation on the Metal GPU side
The latest commit in ds4-spark moved the output head computation for Markov draft to the Metal GPU side, eliminating the CPU-side Q8_0 dequantization step.
yuhai-china/ds4-spark
The latest commit in ds4-spark moved the output head computation for Markov draft to the Metal GPU side, eliminating the CPU-side Q8_0 dequantization step.
View on GitHub ↗- stars
- ★ 1
- Forks
- 0
- Language
- C
- License
- MIT
Posts
1No matching stories.