Model Access and Routing
Gateways and routers that provide model-compatible APIs, select providers, enforce usage policy, or relay subscriptions; it excludes local inference engines and MCP tool proxies.
| Project | What it does | Stars | Language | License | Latest release |
|---|---|---|---|---|---|
| diegosouzapw/omniroute | Routes requests across 359 providers and 1,200+ models through one endpoint with quota-aware fallback. | ★ 78K | TypeScript | MIT | v3.8.51 |
| yetone/magpie | A local gateway translates four model protocols and routes agent requests across accounts and models using quotas and weights. | ★ 15.7K | Go | MIT | v0.1.1285 |
| yinsongxu/llm2jev | Turns existing local LLMs and MLLMs into Jev-style structured decision models without fine-tuning, returning judgments from one prefill. | ★ 449 | Python | Apache-2.0 | v0.2.0 |
| jevagentharness/jevagentharness | A local OpenAI-compatible proxy that classifies coding-agent steps and routes them to fast or strong models. | ★ 13 | Python | MIT | — |