HN Showcase
Back to browse
GitHub Repository

Open-source, OpenAI-compatible LLM gateway you run yourself. One endpoint for 40+ providers, with virtual keys, budgets, and usage tracking.

74 starsPython

Otari: your open-source LLM control plane

by angpt·Jul 6, 2026·4 points·0 comments
Visit ProjectView on HN

AI Analysis

●●SolidSlickSolve My Problem

Mozilla-backed LLM gateway competing with LiteLLM and Portkey.

Strengths
  • •Budgets enforced before requests run, not reconciled after billing
  • •Virtual keys scoped and revocable without rotating provider credentials
  • •Any-llm routing layer supports 40+ providers through one endpoint
Weaknesses
  • •LLM gateway category already has LiteLLM, Helicone, Portkey
  • •Mozilla backing adds credibility but no architectural novelty
Category
AI/ML
Target Audience

Engineering teams managing multiple LLM providers and API costs

Similar To

LiteLLM · Portkey · Helicone

Similar Projects

Infrastructure●●Solid

LLM-Gateway – Zero-Trust LLM Gateway

Zero-trust networking via zrok beats LiteLLM when your GPUs sit behind NAT.

Big BrainSolve My Problem
michaelquigley
713mo ago