Developer Tools●●Solid
LLM-mock – Record and replay OpenAI/Anthropic calls in pytest (v1.0)
HTTP-layer interception for deterministic LLM tests without touching production code.
Solve My ProblemCozy
roman_t
326d ago
Back to browse
LLM-mock – Record real LLM API responses once, replay them in tests
by roman_t·May 22, 2026·1 point·0 comments
AI Analysis
●●●BangerSolve My ProblemBig Brain
Intercepts HTTP transport layer so production code needs zero changes.
Strengths
- •Human-readable JSON fixtures make debugging test failures straightforward.
- •pytest decorator integration avoids context managers inside test functions.
- •Eliminates non-determinism and cost from CI runs hitting real APIs.
Weaknesses
- •Only supports httpx-based clients; requests library users need adapters.
- •No built-in fixture diffing to detect when upstream model behavior drifts.
Category
Target Audience
Python developers writing integration tests for LLM-powered apps
Similar To
VCR.py · Betamax · responses
Similar Projects
Developer Tools●●●Banger
Orchid – Local-first record and replay for AI agent debugging
Deterministic replay of agent runs without mocking—that's genuinely new.
Big BrainSolve My Problem
brightmonkey
4225d ago
Developer Tools●●●Banger
mcp-recorder – VCR.py for MCP servers. Record, replay, verify
Catches silent MCP breakage VCR.py never could—schema drift detection.
Solve My ProblemBig BrainShip It
caballeto
604mo ago
Developer Tools●●●Banger
Evalcraft – cassette-based testing for AI agents (pytest, $0/run)
VCR for LLM calls—eliminates API costs and non-determinism in agent testing.
Solve My ProblemShip ItSlick
beyhang
104mo ago
AI/ML●●●Banger
Retrace fork a failed AI agents run, replay it, prove the fix
Fork from failed agent runs and prove fixes before shipping—LangSmith doesn't do this.
Solve My ProblemShip It
Yashwanthbogam
3024d ago
Education●●Solid
Practicing Interview with AI
Live feedback on rambling interviews, but Pramp and MockInterview exist.
Solve My Problem
visujosh
104mo ago