Developer Tools●Mid
Byok-relay – self-hosted proxy for BYOK LLM apps without CORS issues
Simple relay proxy for BYOK apps, but LiteLLM and Cloudflare Workers already solve this.
Ship It
avikalp
101mo ago
Back to browse
GitHub Repository
Privacy-first LLM proxy and AI gateway — load balancing, multi-provider routing, API key management, usage tracking, rate limiting. Self-hosted. Zero knowledge of your prompts.
109 starsGo
VoidLLM – privacy-first LLM proxy (Go, self-hosted)
by chrisremo85·Mar 23, 2026·3 points·4 comments
AI Analysis
●●SolidSolve My ProblemSlick
Zero-knowledge architecture means prompts never touch disk — unlike LiteLLM.
Strengths
- •Sub-2ms overhead with zero-knowledge pass-through by architecture.
- •Org/team/user key scoping with per-level rate limits and token budgets.
- •Model aliases let clients call 'default' while you route anywhere.
Weaknesses
- •LiteLLM and Portkey already dominate the LLM proxy space.
- •BSL 1.1 license is more restrictive than typical open source.
Category
Target Audience
Engineering teams managing multiple LLM API keys and providers
Similar To
LiteLLM · Portkey · Helicone
Similar Projects
AI/ML●●Solid
Llama-dash – local LLM operators dashboard and proxy
Granular API key controls and token cost tracking beat basic llama.cpp wrappers.
Niche GemShip It
ndom91
1026d ago
Developer Tools●●Solid
Rotato – Node.js proxy that rotates LLM API keys on 429 errors
Zero-dependency proxy handles 429s better than writing custom retry logic in your app.
Solve My Problem
heliskyr2
201mo ago
Developer Tools●●●Banger
Key rotation for LLM agents shouldn't require a proxy
In-process key rotation with state machine simplicity instead of LiteLLM/Redis overhead.
Solve My ProblemBig BrainShip It
EmptyDrum
523mo ago
Developer Tools●●Solid
Open-source proxy to track Claude API costs by team
Drop-in Claude API proxy with real-time cost dashboard—but Anthropic's own billing UI exists.
Solve My ProblemShip It
reshevyas
123mo ago
Developer Tools●●Solid
PrismCat – Local transparent proxy and debugging console for LLM APIs
Subdomain routing means zero /etc/hosts edits—just change base_url and capture everything.
Big BrainSolve My Problem
etgpao
2220d ago