Back to browse
GitHub Repository

GPU ML architecture exploration tool

3 starsGo

Mixlab, an ML arch lab in Go. JSON config, Metal and CUDA, 1.6s builds

by mrothroc·Apr 22, 2026·2 points·1 comment

AI Analysis

●●●BangerBig BrainNiche GemShip It

JSON-defined ML architectures in Go beat Python boilerplate for rapid iteration.

Strengths
  • JSON configs eliminate Python boilerplate for architecture search experiments.
  • Metal and CUDA parity requires zero code changes between platforms.
  • Go compilation speed enables faster CLI iteration than Python scripts.
Weaknesses
  • Niche audience limits adoption to Go-loving ML researchers specifically.
  • Depends entirely on MLX ecosystem maturity and backend support.
Category
Target Audience

ML researchers and engineers prototyping architectures

Similar To

MLX · PyTorch Lightning · Hydra

Post Description

I built a tool for quickly testing different ML architectures. Define a model in JSON, train on your Mac (Metal) or ship the same config to a cloud GPU (CUDA). No code changes between platforms.

Why: I wanted to compare attention vs Mamba vs GQA at different parameter budgets without writing PyTorch for each experiment. Edit a JSON config, hit enter, see loss numbers. It will race different configs for you. The number one goal is iteration speed.

JSON config lets you chain together common ML blocks (attention, GQA, mamba, RetNet, and several more) and optimizers (muon, adamw) and compiles them to MLX IR, which can either run on Metal or CUDA backends.

Why Go: 1.6s builds, built-in profiling (mixlab -cpuprofile gives you a flame graph), import-based extensibility for custom blocks. No C++ extensions, no custom build systems. And personally I prefer strongly-typed, compiled languages.

On a Shakespeare benchmark matching nanoGPT (6L, 6H, d=384, 10.8M params): val loss 1.5527 on M1 Max, 1.5588 on A40. PyTorch numerical parity confirmed to 8 decimal places.

brew install mrothroc/tap/mixlab

https://github.com/mrothroc/mixlab

Similar Projects

Developer Tools●●Solid

Ucpify – JSON config to UCP-compliant commerce server

Drop a merchant-config.json into the CLI and you get 13 ready-made UCP endpoints — catalog, checkout lifecycle, orders, plus OAuth metadata — with Stripe/PayPal and SQLite wired up. The built-in OAuth identity-linking for agent workflows is the most interesting move; it's a focused, practical tool for prototyping UCP-compliant stores but not a substitute when you need bespoke business logic or complex fulfillment.

Solve My ProblemNiche Gem
init0
203mo ago