Mlx-serve – LLM inference server for Apple Silicon, written in Zig

Neutral, reproducible benchmark for local LLMs on Apple Silicon (Mac · iPhone · iPad) — MLX, llama.cpp, CoreML, Apple Foundation Models

Talk to your Mac, query your docs, no cloud required. On-device voice AI + RAG

Preflight checks and collision prevention for local AI inference workloads