Back to browse
GitHub Repository

A lightweight autograd engine inspired by PyTorch and micrograd

4 starsPython

Macrograd – Micrograd, but with Tensors

by polyrhachis·Feb 13, 2026·1 point·0 comments

AI Analysis

●●SolidNiche GemShip It
The Take

Takes micrograd's toy autodiff idea and scales it to real tensor operations with NumPy and optional CuPy GPU support. The repo exposes an nn-like module, common activations (ReLU/Softmax), self-attention and an MNIST MLP example, so it's excellent as a learning resource. It's explicitly flagged as WIP — expect performance and OOM rough edges, so treat it as a study tool rather than a training backbone.

Category
Target Audience

Students, ML learners, hobbyist researchers and engineers who want to understand or prototype autograd and simple neural nets

Post Description

I built a tensor-based version of the micrograd by Andrej Karpathy, it supports GPU acceleration with CuPy

Similar Projects

AI/ML●●Solid

An experimental tensor DSL/compiler with explicit scheduling

Three-concept scheduling model targeting FlashAttention, but generated code isn't performant yet.

Big BrainBold Bet
loganboyd
5112d ago