Back to browse
GitHub Repository

Catch LLM cost changes in code review. Infracost for LLM spend.

4 starsPython

Tokentoll, a CI gate for LLM API cost regressions

by Jwrede·May 30, 2026·2 points·0 comments

AI Analysis

●●SolidSolve My ProblemShip It

Infracost for LLM spend that fails CI before model swaps burn your budget.

Strengths
  • Static analysis catches cost regressions pre-merge instead of runtime observability.
  • Policy-as-code configuration allows custom budget thresholds per endpoint or model.
  • Posts PASS/FAIL verdicts on GitHub PRs with specific blocking findings.
Weaknesses
  • Static analysis cannot predict runtime token counts from dynamic user input.
  • Limited to Python and JavaScript ecosystems, missing Go or Java support.
Target Audience

Engineering leads managing LLM spend, Backend developers building AI features

Similar To

Infracost · LangSmith · Helicone

Similar Projects