AI/ML●●●Banger
TRiP – a complete transformer engine in C built from scratch just by me
From-scratch C transformer engine with training and vision, built by one person.
WizardryDark Horse
carlovalenti
3862mo ago
Back to browse
GitHub Repository
A complete transformer engine in C — inference, training, chat, vision.
78 starsC
My lunch-break transformer in C became a book about my toddlers
by carlovalenti·Jul 10, 2026·1 point·0 comments
AI Analysis
●●●BangerWizardryBig BrainCozy
Pure C transformer engine with training and vision, more comprehensive than llama2.c.
Strengths
- •Full backpropagation training with AdamW, gradient clipping, and cosine annealing LR scheduler
- •Mmap-based memory optimization enables large models on limited hardware
- •Transparent about AI-generated portions—json parser, safetensors, jpeg handling only
Weaknesses
- •Explicitly not tracking latest model releases or competing on performance
- •Vision support limited to PaliGemma with X11 display dependency
Category
Target Audience
Developers learning transformer internals, ML educators, hobbyists
Similar To
llama2.c · nanoGPT · llama.cpp
Similar Projects
Developer Tools●●●Banger
Trained a 12M transformer on an ML framework we built from scratch
Custom CUDA kernels and Rust backend with a TypeScript API built by students in four months.
WizardryBig BrainShip It
caliandbust
222mo ago
Education●●Solid
A book that builds GPT-2, Llama 3, DeepSeek from scratch in PyTorch
Loads real Meta and OpenAI weights, not just training from scratch.
Niche GemBig Brain
s1lv3rj1nx
212mo ago
Education●Mid
Building a GPT from scratch: What I learned and why it mattered
Another transformer-from-scratch tutorial in a saturated space.
Cozy
pirosb3
203mo ago
Education●Mid
I built 10 ML algos from scratch because fit() predict() are not enough
Yet another ML-from-scratch teaching repo in a crowded educational space.
CozyNiche Gem
akmoleksandr
621mo ago
Data●●Solid
We built Cursor, but for data transformations (open source)
Cursor for data transformations using Ibis to standardize AI-generated SQL pipelines.
Ship ItSolve My Problem
naren87
102mo ago