github.devotd.
项目

xorbitsai/inference

Swap GPT for any LLM by changing a single line of code. Xinference lets you run open-source, speech, and multimodal models on cloud, on-prem, or your laptop — all through one unified, production-ready inference API.

在 GitHub 查看 ↗
星标
★ 9.6K
复刻
884
语言
Python
许可证
Apache-2.0
最新版本
v4.0.1

文章

1