AI/ML●●Solid
Llama-dash – local LLM operators dashboard and proxy
Granular API key controls and token cost tracking beat basic llama.cpp wrappers.
Niche GemShip It
ndom91
1015d ago
Back to browse
GitHub Repository
Bring your own key (BYOK) relay to enable lightweight frontend-only apps to use LLMs using the user's API keys without hitting CORS.
50 starsJavaScript
Byok-relay – self-hosted proxy for BYOK LLM apps without CORS issues
by avikalp·Apr 30, 2026·1 point·0 comments
AI Analysis
●MidShip It
Simple relay proxy for BYOK apps, but LiteLLM and Cloudflare Workers already solve this.
Strengths
- •Encrypts user API keys at rest with AES-256-GCM before proxying requests to providers.
- •Supports streaming responses and covers major providers like Anthropic, OpenAI, and Google.
- •Minimal footprint with easy extension for any OpenAI-compatible endpoint via header config.
Weaknesses
- •Self-hosting a proxy for CORS is a solved pattern with many established zero-config alternatives.
- •Adds operational overhead for developers who could use serverless functions or LiteLLM instead.
Category
Target Audience
Frontend developers building BYOK AI applications
Similar To
LiteLLM · Cloudflare Workers · llm-proxy
Similar Projects
Infrastructure●●Solid
VoidLLM – privacy-first LLM proxy (Go, self-hosted)
Zero-knowledge architecture means prompts never touch disk — unlike LiteLLM.
Solve My ProblemSlick
chrisremo85
342mo ago
Developer Tools●●Solid
PrismCat – Local transparent proxy and debugging console for LLM APIs
Subdomain routing means zero /etc/hosts edits—just change base_url and capture everything.
Big BrainSolve My Problem
etgpao
228d ago
Infrastructure●●Solid
Use an Android Phone as an HTTP Proxy
Turns a friend's Android into a geo-spoofing exit node without paying for a VPN.
Niche GemBig Brain
viru7
101mo ago
Security●●●Banger
InferShield – open-source security proxy for LLM inference
LLM-specific threat detection (prompt injection, jailbreaks, exfiltration) that WAFs completely miss.
Solve My ProblemWizardry
Alex-Hosein
123mo ago
Developer Tools●Mid
Corsproxy – Fix CORS Errors Instantly – Free for Development
Useful free tier, but AllOrigins and CORS Anywhere already solve this.
Solve My ProblemCrowd Pleaser
mariusbolik
5527d ago