Back to browse
GitHub Repository

Free, Open-Source AI API Gateway with Gemini, OpenAI & Anthropic Compatibility in 1 file

39 starsTypeScript

Turn your Google accounts into a free, load-balanced LLM API gateway

by ariozgun·May 27, 2026·4 points·5 comments

AI Analysis

●●SolidBig BrainShip It

Multi-account rotation with cooldowns beats single-account rate limits.

Strengths
  • Multi-account rotation with automatic cooldowns, retries, and quota handling
  • OpenAI and Anthropic API compatibility layers for SDK drop-in usage
  • Next.js admin console with usage monitoring and API key management
Weaknesses
  • Relies on Google's free tier which could change or get accounts banned
  • No enterprise features or SLA guarantees for production usage
Target Audience

Developers building AI apps who want free Gemini API access

Similar To

LiteLLM · Portkey · AI Gateway proxies

Similar Projects

Infrastructure●●Solid

LLM-Gateway – Zero-Trust LLM Gateway

Zero-trust networking via zrok beats LiteLLM when your GPUs sit behind NAT.

Big BrainSolve My Problem
michaelquigley
712mo ago
Infrastructure●●Solid

Bifrost: Fastest enterprise AI gateway

Bifrost combines an OpenAI-compatible front door with adaptive load balancing, semantic caching, automatic failover, cluster mode and a built-in web UI — you can spin it up with npx or Docker in seconds. The performance claims (sub-100µs overhead at 5k RPS, '50x faster than LiteLLM') and multi-provider routing are the project's selling points; I want to see independent benchmarks and deeper docs on guardrails/provider quirks before trusting it for critical workloads.

WizardrySolve My ProblemSlick
aanthonymax
103mo ago
AI/ML●●Solid

Stackit – Pruning LLM context windows using a branching chat UI

The ability to 'fork' a chat into nested child cards that preserve exact DOM selection and prune the history array is a clever, pragmatic answer to 'context pollution'. Real-time token streaming, local-only API key storage, and CSS tricks like contain: paint show attention to performance and privacy. It's a browser-hack that feels powerful for deep research, but it will remain fragile and tightly coupled to Gemini's UI unless it expands to other providers or formalizes a more stable integration layer.

Niche GemWizardry
jesterwayne
103mo ago