AI/ML●Mid
We benchmarked 3 AI video detection APIs on 190 videos
190-video benchmark when Hive, Reality Defender, and Deepware already compete here.
Crowd Pleaser
ortalboh
213mo ago
Back to browse
GitHub Repository
Discover benchmark functions, run them across many seeds, and statistically detect regressions against a saved baseline.
0 starsPython
Pybench, Pytest but to check non regression of noisy benchmarks
by ururu01010·Jun 26, 2026·2 points·0 comments
AI Analysis
●●SolidNiche GemBig Brain
Paired seed comparison beats two-sample tests for detecting benchmark regressions.
Strengths
- •Paired seed methodology enables more sensitive regression detection than standard approaches.
- •Git-committed baselines enable historical comparison across commits.
- •Exits non-zero on regression for seamless CI integration.
Weaknesses
- •Benchmark regression detection already has established tools like pytest-benchmark.
- •No Windows-specific testing mentioned in documentation.
Category
Target Audience
Python developers running performance benchmarks
Similar To
pytest-benchmark · codspeed · airspeed-velocity
Similar Projects
Security●●Solid
A benchmark for SAST exploit chain and evasion detection
First public SAST benchmark for Go and Rust with adversarial evasion test cases.
Niche GemBold Bet
ThailandJohn
212mo ago
AI/ML●●●Banger
Willitrun – check if any ML model runs on any device (benchmark-backed)
Real benchmark database for edge ML when most tools only guess at performance.
Solve My ProblemDark Horse
smoothyy
122mo ago
Productivity●Mid
Salary benchmarks, ATS keyword trends and skills demand for data jobs
Useful career signals, but LinkedIn Salary and Levels.fyi already dominate this space.
Solve My Problem
datamatastudios
101mo ago
Developer Tools●●●Banger
Cheddar-bench – unsupervised benchmark for coding agents
Unsupervised bug benchmark using agents as both attackers and defenders—novel scoring methodology.
Big BrainWizardryShip It
przadka
904mo ago
AI/ML●●●Banger
Pencil Puzzle Bench – LLM Benchmark for Multi-Step Verifiable Reasoning
62k puzzle benchmark reveals reasoning depth, cost variance, and stark US vs China model gaps.
Big BrainCrowd PleaserSolve My Problem
bluecoconut
503mo ago