zhongkaifu/tensorsharp

介绍 zhongkaifu/tensorsharp 的本地 GGUF 推理能力、提供的接口以及支持范围。

GitHub 项目说明: A native .NET LLM inference engine and agent runtime for GGUF models. TensorSharp provides a console application, a web-based chatbot interface, iPhone App, and Ollama/OpenAI-compatible HTTP APIs for programmatic access. It supports Windows/MacOS/iOS/Linux with full GPU capability