freellmapi vs OmniRoute
OpenAI-compatible proxy that stacks free tiers of 18 LLM providers (~1.7B tokens/mo) behind one /v1 — smart routing, failover, per-key quota tracking; Claude Code and Codex shims included. — versus — Free MIT AI gateway for coding CLIs: one endpoint over 352 providers (150+ free tiers) and 1,200+ models with quota-aware auto-fallback, RTK+Caveman token compression, MCP/A2A and a desktop app.
Same idea, two scales: FreeLLMAPI stacks 18 providers' free tiers (~1.7B tokens/month) behind one /v1; OmniRoute stacks 352 providers with quota-aware scheduling, a desktop app and coding-CLI integrations.
| freellmapi | OmniRoute | |
|---|---|---|
| Stars | 24k | 62k |
| Forks | 3.3k | 8.6k |
| Language | TypeScript | TypeScript |
| License | MIT | MIT |
| Last activity | 2 days ago | today |
| Topics | gateway | gateway, coding |
| Curated connections | 5 | 6 |
freellmapi — the curator's take
Use it for personal experimentation when you want real working inference for $0: free tiers stacked across Google/Groq/Cerebras/Mistral/etc., a Thompson-sampling router with 20-attempt failover, and Anthropic Messages + Responses API shims so Claude Code and Codex CLI run straight against the free pool. Also does embeddings, images, TTS, and an MCP server agents can query for live model availability. NOT for production or teams — single-user by design, no billing, and several provider free tiers are ToS-gray (NVIDIA's is eval-only; the repo itself says personal experimentation only). Freemium catch: new models reach free installs 30 days late unless you pay $19/yr for the live catalog.
OmniRoute — the curator's take
The maximalist gateway for people who refuse to pay per token: it catalogues 444 free-tier entries, computes an honest monthly budget (~1.47B tokens, re-audited fortnightly, regional-ID quotas shown separately), and schedules Claude Code, Codex, Cursor, OpenCode, Cline or Copilot traffic across them with quota-aware fallback so a limit never stops you. 61k stars and 550 contributors are real. NOT for a production application: 352 providers means 352 terms of service and 352 latency profiles, and the value is breadth, not guarantees. For a small, predictable stack use a purpose-built gateway; use OmniRoute to keep coding when your subscription runs dry.