New
nvidia/flare-local-inference — a Rust local inference server with no Python
A local inference server repository that runs models directly on NVIDIA graphics devices, with the Python preparation stage and the Rust serving runtime kept separate.
nvidia/flare-local-inference
A local inference server repository that runs models directly on NVIDIA graphics devices, with the Python preparation stage and the Rust serving runtime kept separate.
View on GitHub ↗- stars
- ★ 139
- Forks
- 17
- Language
- Python
- License
- Apache-2.0
Posts
1No matching stories.