HN Showcase
Back to browse
GitHub Repository

Catch LLM cost changes in code review. Infracost for LLM spend.

4 starsPython

Tokentoll, a CI gate for LLM API cost regressions

by Jwrede·May 30, 2026·2 points·0 comments
Visit ProjectView on HN

AI Analysis

●●SolidSolve My ProblemShip It

Infracost for LLM spend that fails CI before model swaps burn your budget.

Strengths
  • •Static analysis catches cost regressions pre-merge instead of runtime observability.
  • •Policy-as-code configuration allows custom budget thresholds per endpoint or model.
  • •Posts PASS/FAIL verdicts on GitHub PRs with specific blocking findings.
Weaknesses
  • •Static analysis cannot predict runtime token counts from dynamic user input.
  • •Limited to Python and JavaScript ecosystems, missing Go or Java support.
Target Audience

Engineering leads managing LLM spend, Backend developers building AI features

Similar To

Infracost · LangSmith · Helicone

Similar Projects