New
happyme531/open_rknpu2_lm_infer — Docker deployment support for RK3588
An ARM64 container image publishing path and a Compose deployment template have been added to open_rknpu2_lm_infer, the LLM inference engine for the RK3588 NPU.
happyme531/open_rknpu2_lm_infer
An ARM64 container image publishing path and a Compose deployment template have been added to open_rknpu2_lm_infer, the LLM inference engine for the RK3588 NPU.
View on GitHub ↗- stars
- ★ 13
- Forks
- 2
- Language
- Rust
- License
- AGPL-3.0
- Latest release
- v0.3.1
Posts
1No matching stories.