New
nvidia/tensorrt-llm v1.2.1 — LLM Inference Optimization for NVIDIA GPUs
Summarizes the composition of nvidia/tensorrt-llm, which optimizes inference of LLM and Visual Gen models on NVIDIA GPUs, along with its latest release v1.2.1.
nvidia/tensorrt-llm
Summarizes the composition of nvidia/tensorrt-llm, which optimizes inference of LLM and Visual Gen models on NVIDIA GPUs, along with its latest release v1.2.1.
View on GitHub ↗- stars
- ★ 14.9K
- Forks
- 2.8K
- Language
- Python
- License
- NOASSERTION
- Latest release
- v1.2.1
Posts
1No matching stories.