Back to browse
GitHub Repository

A native Apple Silicon activity monitor for llama.cpp

0 starsSwift

Llamatop

by fragmede·Jul 22, 2026·1 point·1 comment

AI Analysis

●●SolidCozyNiche Gem

Finally answers if llama.cpp is actually working by reading Apple GPU counters directly.

Strengths
  • Reads Apple GPU pipeline counters (Device, Renderer, Tiler) directly from IOKit.
  • Zero dependencies, no daemon, and no root access required for installation.
  • Distinguishes between llama.cpp specific load and system-wide background noise.
Weaknesses
  • Extremely narrow scope; only useful for the specific niche of local LLM inference.
  • macOS and Apple Silicon only, excluding Linux and Windows users entirely.
Target Audience

AI developers, local LLM runners on macOS

Similar To

htop · Activity Monitor · nvtop

Post Description

I had codex make this for me so I could see what llama.cpp was doing on my mac. Vibecoded in swift, hit 1 for more processor details, hit m for more memory details. Enjoy!

Similar Projects

Developer Tools●●●Banger

WattSeal – PC power consumption monitor

Per-app wattage attribution using RAPL and GPU counters when other monitors only show component totals.

Big BrainNiche Gem
Daminoup
404mo ago

GPU-hot Dashboard for monitoring Nvidia GPUs on remote servers

Shoots for zero-setup GPU visibility: one docker run spins up a service you open in the browser to see live NVIDIA metrics without Prometheus, SSH, or dashboards to configure. The UI and interactive demo show attention to UX and make it instantly useful for small clusters or single-node setups. It doesn’t reinvent observability — if you need long-term metrics, alerting, or enterprise integrations you’ll still reach for exporters + Grafana — but for lightweight, immediate GPU troubleshooting this is convenient and focused.

Niche GemSlick
github-trending
215mo ago

We built an MCP for Windows – ask Claude about CPU, temps, and privacy

MCP wrapper around AppControl — Windows only, requires the desktop app running.

Niche Gem
suprnurd
853mo ago