Developer Tools●●Solid
Run any LLM inside Claude Code. A local auditable proxy for 7 providers
Switch Claude Code to Codex, Gemini, or Ollama without rewriting code.
Solve My ProblemDark Horse
sarunasch
203mo ago
Back to browse
GitHub Repository
A restful API designed to route user prompts to various AI model providers.
113 starsPython
Free AI API gateway that auto-fails over Gemini, Groq, Mistral, etc.
by markfront·Mar 31, 2026·7 points·1 comment
AI Analysis
●●SolidSolve My ProblemBig Brain
Free-tier failover across Gemini, Groq, Mistral beats single-provider rate limits.
Strengths
- •Drop-in OpenAI-compatible endpoint works with LangChain, LlamaIndex, and any OpenAI SDK
- •Circuit breakers automatically quarantine failing providers while round-robin distributes remaining traffic
- •Combines Gemini, Groq, Mistral, and Cerebras free tiers into single unified endpoint
Weaknesses
- •LiteLLM, Portkey, and other API gateways already handle multi-provider routing and failover
- •Free tier rate limits still constrain high-volume production applications significantly
Category
Target Audience
Developers building AI applications on limited budgets
Similar To
LiteLLM · Portkey · AI gateway services
Similar Projects
Infrastructure●●Solid
Styx, Open-source AI gateway with intelligent auto-routing (MCP-native)
First gateway with native MCP server—connect Claude Code or Cursor in one command.
SlickSolve My Problem
timmx7
202mo ago
AI/ML●Mid
RelayFreeLLM — Free AI Gateway with Auto-Failover (Updates)
Free AI gateway with failover, but LiteLLM already aggregates providers with better maturity.
Solve My ProblemShip It
markfront
201mo ago
Developer Tools●Mid
OpenGem – Free, self-healing load-balanced proxy for Google Gemini API
Reverse-engineers free Gemini API; smart quota rotation, but against Google's terms of service.
Bold Bet
ariozgun
203mo ago
Infrastructure●Mid
Sentinel – Go LLM Proxy with 13ms Semantic Cache and PII Scrubbing
Multi-model LLM router with semantic cache, but caching+fallback already exist (Anthropic, LangSmith, Unify).
SlickCrowd Pleaser
ChipShotz
113mo ago
Infrastructure●●Solid
LLM-Gateway – Zero-Trust LLM Gateway
Zero-trust networking via zrok beats LiteLLM when your GPUs sit behind NAT.
Big BrainSolve My Problem
michaelquigley
712mo ago