Back to browse
GitHub Repository

Find the local LLM that actually runs and performs best on your hardware. Ranked by real, recency-aware benchmarks, not parameter count. One command, run it instantly.

2,608 starsPython

Find the best local LLM for your hardware, ranked by benchmarks

by andyyyy64·May 15, 2026·283 points·68 comments

AI Analysis

●●SolidSolve My ProblemShip It

Ranks models by actual benchmark scores instead of just fitting the biggest model in VRAM.

Strengths
  • Recency-aware scoring demotes stale leaderboards so new models beat older, larger ones.
  • Simulates specific GPU configs like RTX 4090 to predict performance before buying hardware.
  • Aggregates diverse benchmarks like LiveBench and Chatbot Arena into a single weighted score.
Weaknesses
  • Relies on third-party benchmark data consistency which can vary wildly between sources.
  • Doesn't actually run the models locally to verify speed, relying on theoretical estimates.
Category
Target Audience

Developers running local LLMs on consumer hardware

Similar To

HuggingFace Hub · Ollama · LM Studio

Similar Projects

AI/ML●●●Banger

Whichllm – Find and run the best local LLM for your hardware

One command finds and runs the best local LLM for your exact hardware specs.

Solve My ProblemBig BrainNiche Gem
andyyyy64
302mo ago