Snitch – Deterministic prose claim verifier for coding agents. (OSS)
Catches AI agents lying about test results by verifying against actual git and filesystem state.
When Claude says “tests pass”, makoto checks the record — every claim held against the agent's own logged deeds; fakes blocked, not warned. Each check ships at measured zero false positives. 誠
Blocks AI agents from faking work by verifying claims against their own tool history.
Developers using Claude Code for automated tasks
LangSmith · Arize Phoenix · Braintrust
Catches AI agents lying about test results by verifying against actual git and filesystem state.
Blocks false agent claims at the hook level with 22 pre-checks and zero false positives.
Fact-checking extension for AI claims when Pino and others already exist.
Git-based verification catches AI agents lying about shipped features.
Useful verification layer, but manual scraping scripts already do this for free.
Training can't fix hallucinations—verify externally instead. Backed by surprising RLVF data.