Developer Tools●●Solid
Aisbf, a self-hostable OpenAI-compatible AI proxy/router
LiteLLM and OpenRouter already solve multi-provider routing better and have production users.
Big BrainNiche Gem
nextime
241mo ago
Back to browse
GitHub Repository
An OpenAI-compatible LLM proxy that flocks toward the fastest provider
3 starsRust
Sturnus – OpenAI-compatible LLM proxy routing to the fastest provider
by dannyboland·Jun 22, 2026·2 points·0 comments
AI Analysis
●MidBold BetSolve My Problem
Latency-based routing without thresholds competes with LiteLLM and OpenRouter.
Strengths
- •Stateless session affinity header pins follow-up requests across multiple pods
- •Memory-bounded request buffers shed load with 429 instead of OOMing the process
- •Single static binary with no Redis, database, or control plane dependencies
Weaknesses
- •LiteLLM, OpenRouter, and Portkey already solve multi-provider LLM routing
- •No cost optimization or model quality scoring—latency is the only routing signal
Category
Target Audience
Backend engineers running production LLM applications with multiple providers
Similar To
LiteLLM · OpenRouter · Portkey
Similar Projects
Developer Tools●●Solid
Lightport – AI gateway that makes LLM providers OpenAI-compatible
Stripped-down Portkey fork handling protocol translation for 77 providers without enterprise bloat.
Ship ItSolve My Problem
smokybay
101mo ago
Infrastructure●●Solid
UnifyRoute – Self-hosted OpenAI-compatible LLM gateway with failover
Drop-in OpenAI API gateway with failover—LiteLLM does this but this has a dashboard.
Solve My ProblemSlick
unifyroute
113mo ago
Infrastructure●●Solid
LunarGate – a self-hosted OpenAI-compatible LLM gateway
Go gateway with circuit breakers, but auth isn't production-ready yet.
Ship ItNiche Gem
jmartenka
302mo ago
Developer Tools●●Solid
Lightport – open-source AI gateway
Open-source proxy making 77+ LLM providers OpenAI-compatible without the enterprise bloat.
Niche GemShip It
statements
101mo ago
AI/ML●●Solid
Llamactl – Self-hosted LLM manager with OpenAI-compatible routing
Multi-backend LLM manager when Ollama and LM Studio already handle this.
Solve My ProblemNiche Gem
lordmathis
203mo ago