Infrastructure●●Solid
UnifyRoute – Self-hosted OpenAI-compatible LLM gateway with failover
Drop-in OpenAI API gateway with failover—LiteLLM does this but this has a dashboard.
Solve My ProblemSlick
unifyroute
113mo ago
Back to browse
GitHub Repository
A restful API designed to route user prompts to various AI model providers.
136 starsPython
RelayFreeLLM — Free AI Gateway with Auto-Failover (Updates)
by markfront·Apr 11, 2026·2 points·0 comments
AI Analysis
●MidSolve My ProblemShip It
Free AI gateway with failover, but LiteLLM already aggregates providers with better maturity.
Strengths
- •Session affinity via X-Session-ID header maintains provider-side context caching for faster responses.
- •Four context pruning modes (Static, Dynamic, Reservoir, Adaptive) handle long conversation histories.
- •Strict boot validation verifies all API keys and models before server starts accepting traffic.
Weaknesses
- •Provider aggregation and failover already solved by LiteLLM, Portkey, and Helicone with more features.
- •Free tier rate limits are still free tier rate limits—aggregation doesn't create more quota, just spreads it.
Category
Target Audience
Independent developers and hobbyists building AI apps without paid API budgets
Similar To
LiteLLM · Portkey · Helicone
Similar Projects
AI/ML●●●Banger
RelayFreeLLM – Free AI Gateway with Auto-Failover (Update))
Eliminates 429 errors by rotating across eight free providers automatically.
Crowd PleaserSolve My Problem
markfront
101mo ago
Developer Tools●●Solid
Free AI API gateway that auto-fails over Gemini, Groq, Mistral, etc.
Free-tier failover across Gemini, Groq, Mistral beats single-provider rate limits.
Solve My ProblemBig Brain
markfront
712mo ago
Infrastructure●●Solid
LunarGate – a self-hosted OpenAI-compatible LLM gateway
Go gateway with circuit breakers, but auth isn't production-ready yet.
Ship ItNiche Gem
jmartenka
302mo ago
Infrastructure●●Solid
LLM-Gateway – Zero-Trust LLM Gateway
Zero-trust networking via zrok beats LiteLLM when your GPUs sit behind NAT.
Big BrainSolve My Problem
michaelquigley
712mo ago
Infrastructure●●Solid
Bifrost: Fastest enterprise AI gateway
Bifrost combines an OpenAI-compatible front door with adaptive load balancing, semantic caching, automatic failover, cluster mode and a built-in web UI — you can spin it up with npx or Docker in seconds. The performance claims (sub-100µs overhead at 5k RPS, '50x faster than LiteLLM') and multi-provider routing are the project's selling points; I want to see independent benchmarks and deeper docs on guardrails/provider quirks before trusting it for critical workloads.
WizardrySolve My ProblemSlick
aanthonymax
104mo ago