xorbitsai/inference

Swap GPT for any LLM by changing a single line of code. Xinference lets you run open-source, speech, and multimodal models on cloud, on-prem, or your laptop — all through one unified, production-ready inference API.

스타

★ 9.6K

포크

884

언어

Python

라이선스

Apache-2.0

최신 릴리스

v4.0.1