Back to browse
GitHub Repository

One command to run the full AI audit stack: Gateway + Policy Engine + Episode Store + Jaeger + Prometheus. Make up. 8 seconds.

9 starsPython

Air Blackbox – Open-source flight recorder for AI agents

by shotwellj·Feb 20, 2026·1 point·0 comments

AI Analysis

●●●BangerWizardrySolve My ProblemZero to One

Flight recorder for AI agents: record, replay, enforce policies on every LLM call.

Strengths
  • Multi-component architecture (Gateway, Episode Store, Policy Engine, OTel Collector) tackles a genuinely urgent problem with structured approach.
  • Interactive browser-based demos for each component lower barrier to understanding without installation.
  • Policy enforcement with risk-tiered autonomy and kill switches directly addresses regulatory and safety concerns for agent deployments.
Weaknesses
  • Still in alpha with only 2 stars; adoption and real-world production validation unclear.
  • Comprehensive stack requires Docker Compose orchestration; operational overhead may slow adoption versus simpler single-tool alternatives.
Target Audience

AI/ML engineers, DevOps teams, enterprises deploying autonomous agents

Similar To

OpenTelemetry (tracing foundation) · Anthropic's Workbench (agent governance) · LangSmith (LLM observability)

Similar Projects

Security●●Solid

Air – Open-source black box for AI agents (tamper-evident audit trails)

Instead of another observability dashboard, this project builds a provable audit trail: an OpenAI-compatible reverse proxy that vaults prompts in MinIO and links calls with an HMAC-SHA256 tamper-evident chain, plus replay tooling (replayctl) and Jaeger traces. The cryptographic audit chain and the one-line SDK wrap are clever and practical; the real operational work left to teams will be key management and storage/retention strategy.

WizardryNiche Gem
shotwellj
213mo ago
Security●●●Banger

Unworldly – A flight recorder for AI agents (tamper-proof, HIPAA)

GAP research proved models hide harmful actions in tool calls—this catches them at runtime.

Solve My ProblemZero to OneDark Horse
dilawargopang
103mo ago
Security●●●Banger

Korveo – a local firewall for AI agents

Local firewall blocks agent credential leaks before they leave your machine.

Zero to OneSolve My Problem
amitbidlan
1315d ago