Infrastructure●●Solid
Air – Open-source black box for AI agents (tamper-evident audit trails)
Cryptographic audit chain for agents, but lacks observability dashboards competing tools provide.
Big BrainWizardry
shotwellj
213mo ago
Back to browse
GitHub Repository
Full stack observability for local AI agent development. Provides a llm-proxy to use as LLM provider base URL, logs traces to opik.
27 starsTypeScript
LLM Observability Stack for Local Dev – Agent Super Apy
by simple10·Mar 11, 2026·2 points·0 comments
AI Analysis
●●SolidShip ItSolve My Problem
Mitmproxy integration shows raw HTTP when LangSmith only shows parsed traces.
Strengths
- •Path-based routing to multiple providers through single localhost:4000 endpoint.
- •Mitmproxy web UI captures raw HTTP traffic that standard trace loggers miss.
- •API key management at proxy level removes per-tool credential configuration.
Weaknesses
- •Orchestrates existing tools—Opik, mitmproxy—without novel underlying technology.
- •No multi-user support or deployment docs beyond single-machine local development.
Category
Target Audience
AI developers building agents locally
Similar To
LangSmith · Langfuse · Helicone
Similar Projects
Developer Tools●●Solid
I made a 1 line AI Agent observability tool
One-line AI tracing, but LangSmith, LangFuse, Anthropic Workbench already solve observability.
Solve My ProblemSlick
antonijs
323mo ago
Developer Tools●●Solid
Agent Caching in Fiddler
Proxy-level LLM caching saves tokens during dev without instrumenting your code.
Solve My ProblemNiche Gem
zlatkov
222mo ago
AI/ML●●Solid
Context Gateway – Compress agent context before it hits the LLM
SLM classifiers compress context based on tool call intent before LLM sees it.
Big BrainSolve My Problem
ivzak
97642mo ago
Education●Mid
Complete Guide to AI Agent Observability in Production
Good problem description but no code or templates like LangSmith provides.
Solve My Problem
jmanhype
102mo ago
Developer Tools●●●Banger
Key rotation for LLM agents shouldn't require a proxy
In-process key rotation with state machine simplicity instead of LiteLLM/Redis overhead.
Solve My ProblemBig BrainShip It
EmptyDrum
522mo ago