Back to browse
GitHub Repository

Local-first speech AI benchmarking — compare STT, TTS, emotion & diarization models side by side

8 starsPython

Speechos – Benchmark 25 speech AI models locally, no cloud needed

by hamuf·Feb 28, 2026·1 point·1 comment

AI Analysis

●●SolidDark HorseSolve My Problem

Side-by-side model comparison eliminates guessing which speech engine fits your hardware.

Strengths
  • One-command setup (./dev.sh) with automatic model caching solves the 'which STT is best?' problem pragmatically
  • Covers niche gaps (emotion, diarization, multilingual TTS) alongside main STT/TTS comparison
  • Local-first design is genuine advantage for privacy-sensitive use (healthcare, legal transcription)
Weaknesses
  • Benchmarking metrics are unclear—no latency/accuracy scoring shown, just subjective side-by-side listening
  • Model coverage heavy on Whisper/common libraries, light on commercial APIs (Google Cloud Speech, AWS Transcribe)
Category
Target Audience

ML engineers, speech AI researchers, edge AI product teams

Similar To

Model benchmarking tools (PapersWithCode) · Audio Deepgram playground

Similar Projects

AI/ML●●Solid

ModelSweep - Open-Source Benchmarking for Local LLMs

Postman for local LLMs with LLM-as-Judge and Elo ratings built in.

Ship ItNiche GemSlick
leonickson
202mo ago
AI/ML●●Solid

LLM Debate Benchmark

Side-swapped debate matchups expose model weaknesses standard benchmarks miss.

Big BrainDark Horse
zone411
932mo ago