AI/ML●●Solid
Reproducible open-source STT API benchmarks with full methodology
Fixes WER scores by normalizing '$50' and 'fifty dollars' as equivalent.
Solve My ProblemCozy
jilijeanlouis
112mo ago
Back to browse
GitHub Repository
Benchmark transcription APIs against real meeting audio. Measure WER, diarization, latency, and cost.
3 starsPython
Open-source benchmark for transcription APIs on meeting audio
by eyepaqio·Apr 3, 2026·2 points·0 comments
AI Analysis
●●SolidSolve My ProblemNiche Gem
Tests Deepgram and AssemblyAI on actual crosstalk instead of clean audiobook samples.
Strengths
- •Targets meeting-specific artifacts like crosstalk and screen-share audio bleed in real tests.
- •CLI skips missing API keys instead of crashing on configuration errors.
- •Measures cost per hour alongside technical metrics for real budgeting decisions.
Weaknesses
- •Only supports four adapters; missing Google Cloud Speech and Azure AI.
- •Requires manual ground-truth JSON setup for custom audio samples.
Category
Target Audience
Backend developers, CTOs choosing transcription infrastructure
Similar To
Hugging Face Spaces · MLPerf
Similar Projects
Productivity●●Solid
Dikaletus – meeting recording and transcription using Mistral AI
Dual-channel audio capture via PulseAudio is a genuinely useful detail most wrappers miss.
Niche GemCozy
phillc73
2026d ago
Developer Tools●●●Banger
Mdarena – Benchmark your Claude.md against your own PRs
Mining your own PRs as benchmarks beats generic SWE-bench tasks for agent config tuning.
Big BrainSolve My Problem
hudsongr
2241mo ago
AI/ML●●Solid
Keyterm Filtering for Voice AI
Cuts keyterm hallucinations by 60% before audio hits Deepgram.
Solve My ProblemNiche Gem
mayowa_osibodu
3029d ago
Productivity●●Solid
Ghostmeet – Self-hosted meeting transcription in a Chrome side panel
Local Whisper transcription with zero audio egress, Chrome side panel stays invisible.
CozySolve My Problem
swq115
301mo ago
Developer Tools●Mid
Skylos – A Python dead code finder benchmarked against 9 libraries
Benchmarked dead code finder across FastAPI, Pydantic, Flask—but Vulture, Bandit already solve this.
Solve My Problem
duriantaco
312mo ago