Education●●Solid
Learn GPU programming with coding agents
GPU learning transcript beats sanitized AI stories, but lacks replayable tooling.
Rabbit Hole
vtemian
603mo ago
Back to browse
Building a GPT from scratch: What I learned and why it mattered
by pirosb3·Mar 30, 2026·2 points·0 comments
AI Analysis
●MidCozy
Another transformer-from-scratch tutorial in a saturated space.
Strengths
- •Personal learning journey with practical Claude-assisted approach
- •Bottom-up explanation of tokenizers, embeddings, and attention
Weaknesses
- •Educational content, not a shipped product or tool
- •Karpathy's nanoGPT already covers this thoroughly
Category
Target Audience
Developers wanting to understand LLM internals
Similar To
nanoGPT · Andrej Karpathy tutorials
Similar Projects
Education○Pass
What Installing a New OS Taught Me About Disk Partitions
Personal blog post about learning partitions, not a tool or product.
access2vivek
203mo ago
Open Source●Mid
I built an LSM storage engine from scratch in Rust
LSM engine learning project; interesting technical details but shipping status unclear.
Rabbit HoleBig Brain
nlz
323mo ago
Education●●Solid
A book that builds GPT-2, Llama 3, DeepSeek from scratch in PyTorch
Loads real Meta and OpenAI weights, not just training from scratch.
Niche GemBig Brain
s1lv3rj1nx
211mo ago
Hardware●●Solid
Hacking Sony A6000 for Fun
Clever camera hack solving real USB bottlenecks via GPhoto2, but it's a personal project blog.
Rabbit HoleWizardryCozy
skittleson
303mo ago
Education●●Solid
Train a GPT from scratch in the browser – Karpathy's microGPT
Karpathy's microGPT in the browser with live loss curves, but pedagogical only—no production value.
Eye CandyRabbit Hole
jayyvk
113mo ago