google-ai-edge/litert-lm

google-ai-edge/litert-lm v0.18.0 is Google's open-source inference framework, supporting running LLMs on edge devices and across multiple platforms on top of LiteRT.

View on GitHub ↗

stars: ★ 6.7K
Forks: 0
Language: C++
License: —

Posts

NewOct 21

google-ai-edge/litert-lm v0.18.0 — Edge LLM Inference Runtime

google-ai-edge/litert-lm v0.18.0 is Google's open-source inference framework, supporting running LLMs on edge devices and across multiple platforms on top of LiteRT.

google-ai-edge/litert-lm Inference & servingC++