HN Showcase
Back to browse
GitHub Repository
0 starsRust

ARouter – drop-in OpenAI/Anthropic proxy that cuts cost and fails over

by sricola·Jun 8, 2026·1 point·1 comment
Visit ProjectView on HN

AI Analysis

●●SolidShip ItBig Brain

OpenAI SDK calls Claude through one proxy with conformance-tested wire translation.

Strengths
  • •Cross-provider wire translation lets OpenAI SDK call Anthropic models
  • •Conformance suite validates both real SDKs against proxy on every CI run
  • •Built-in Prometheus metrics and OpenTelemetry traces for observability
Weaknesses
  • •LLM routing proxy category already has Litellm and similar tools
  • •Only supports OpenAI and Anthropic, no provider expansion roadmap visible
Target Audience

Backend developers using LLM APIs in production

Similar To

Litellm · Portkey · Helicone

Similar Projects

Developer Tools●●Solid

LLM Gateway for OpenAI/Anthropic Written in Golang

Runs as a single binary with embedded SQLite and zero-config start, acting as a transparent, provider-agnostic proxy that logs model, tokens, latency, cost and API key hashes while leaving full body capture opt-in. It also proxies streaming responses in real time and exposes stable JSON analytics endpoints — a practical, instrumentable way to get reproducible, audit-ready traces for real LLM traffic, though long-term value depends on how it handles provider edge-cases and SDK compatibility.

Solve My ProblemNiche GemSlick
oatmale
423mo ago
Developer Tools●●Solid

NadirClaw, LLM router that cuts costs by routing prompts right

If you're burning through Claude/OpenAI credits, this is a low-friction stopgap: it classifies prompts in ~10ms and routes trivial tasks to cheaper/local models while reserving premium APIs for complex work. The agentic-task detection, reasoning-aware routing, session pinning and context-window fallback are practical touches that avoid mid-thread model bouncing and 429 failures. It isn't reinventing the space (OpenRouter and others exist), but it's focused on real-world cost tradeoffs and drop-in compatibility.

Solve My ProblemNiche Gem
amirdor
113mo ago
Developer Tools●●Solid

Langasync – Use OpenAI/Anthropic Batch APIs with LangChain Chains

Turns existing LangChain pipelines into first-class batch jobs you can submit to provider batch endpoints without rewriting your chains. It automates JSONL uploads, polling (BatchPoller), provider-specific parsing into unified BatchItem results, partial-failure handling, and on-disk job persistence so batches can outlive your process — Vertex/Azure support is on the roadmap.

Solve My ProblemNiche Gem
basilwoods256
103mo ago