StackMap
Subscribe
Explore / freellmapi
tashfeenahmed

freellmapi

OpenAI-compatible proxy that stacks free tiers of 18 LLM providers (~1.7B tokens/mo) behind one /v1 — smart routing, failover, per-key quota tracking; Claude Code and Codex shims included.

16,180 2,357 TypeScript MITupdated yesterday
gateway
View on GitHubDispute this mapping →
Curator's take

Use it for personal experimentation when you want real working inference for $0: free tiers stacked across Google/Groq/Cerebras/Mistral/etc., a Thompson-sampling router with 20-attempt failover, and Anthropic Messages + Responses API shims so Claude Code and Codex CLI run straight against the free pool. Also does embeddings, images, TTS, and an MCP server agents can query for live model availability. NOT for production or teams — single-user by design, no billing, and several provider free tiers are ToS-gray (NVIDIA's is eval-only; the repo itself says personal experimentation only). Freemium catch: new models reach free installs 30 days late unless you pay $19/yr for the live catalog.

Mapped by ShipWithAI editors · links verified
README.md

FreeLLMAPI

One OpenAI-compatible endpoint. 18 free LLM providers. 161 free models. ~1.7B tokens per month.

Aggregate the free tiers from Google, Groq, Cerebras, NVIDIA, Mistral, OpenRouter, GitHub Models, Cohere, Cloudflare, HuggingFace, Z.ai (Zhipu), Ollama, Kilo, Pollinations, LLM7, OVH AI Endpoints, OpenCode Zen, and AI Horde, plus custom OpenAI-compatible chat, embedding, image, and audio endpoints, behind a single /v1 API. Keys are stored encrypted. A router picks the best available model for each request, falls over to the next provider when one is rate-limited, and tracks per-key usage so you stay under every free-tier cap.

CI GitHub stars License: MIT PRs Welcome Docker image Ask DeepWiki

freellmapi.co · browse all 161 free models on the live catalog

Your router updates its own model catalog. Free installs get each new model 30 days after it ships; Premium gets it the day it lands, and is 79 models ahead right now ($19/yr, cancel anytime).

Fallback chain with per-provider token budget

Contents

Why this exists

Every serious AI lab now offers a free tier — a few million tokens a month, a few thousand requests a day. On its own each tier is a toy. Stacked together, they add up to roughly 1.7 billion tokens per month of working inference capacity, across 160+ models from small-and-fast to reasonably capable.

The problem is that stacking them by hand is painful: twenty-one different SDKs, twenty-one different rate limits, twenty-one places a request can fail. FreeLLMAPI collapses that into one OpenAI-compatible endpoint. Point any OpenAI client library at your local server, and it routes transparently across whichever providers you've added keys for.

And the free-tier landscape shifts weekly: providers launch models, retire them, and change quotas without notice. FreeLLMAPI tracks all of that for you. The router pulls a signed model catalog from freellmapi.co on its own, so your install keeps up without a git pull. See Premium (live catalog) for how fast it keeps up.

Supported providers

Google
Gemini 2.5 Flash · 3.x previews		 Groq
Llama 3.3, Llama 4, GPT-OSS, Qwen3		 Cerebras
Qwen3 235B

Continue your stack

What teams reach for next — and why each earns a place beside freellmapi. Ranked by curator confidence.