New
google-ai-edge/litert-lm v0.18.0 — Edge LLM Inference Runtime
google-ai-edge/litert-lm v0.18.0 is Google's open-source inference framework, supporting running LLMs on edge devices and across multiple platforms on top of LiteRT.
google-ai-edge/litert-lm
google-ai-edge/litert-lm v0.18.0 is Google's open-source inference framework, supporting running LLMs on edge devices and across multiple platforms on top of LiteRT.
View on GitHub ↗- stars
- ★ 6.7K
- Forks
- 762
- Language
- C++
- License
- Apache-2.0
- Latest release
- v0.18.1
Posts
1No matching stories.