AI/ML●●●Banger
I trained a language model that thinks the capital of Japan is Paris
Mamba spine plus masked diffusion for text—claims no prior publication of this combo.
Zero to OneBig BrainDark Horse
farisallafi
15824d ago
Back to browse
"Be horse." – a diffusion language model on an M2 Air
by encrux·Apr 30, 2026·10 points·2 comments
AI Analysis
●●SolidBig BrainNiche Gem
Parallel token decoding beats autoregressive LLMs on throughput, if the math holds up.
Strengths
- •Mask-prob as a model input lets one network handle all noise levels elegantly.
- •Training loop visualizations clearly explain the cross-entropy loss on masked positions.
- •Runs entirely on consumer M2 hardware without needing enterprise GPU clusters.
Weaknesses
- •No benchmarks comparing tokens-per-second against standard autoregressive baselines.
- •Output quality looks poor in the demo, suggesting it's more proof-of-concept than usable.
Category
Target Audience
ML researchers and hobbyists interested in alternative LLM architectures
Similar To
Mercury · LLaDA · Diffusion-LM
Post Description
Be horse.
Similar Projects
AI/ML●●Solid
Meadow Mind – a 7B diffusion LLM plays Gym games with zero training
Fixed-latency language-rule decisions beat traditional token-by-token LLM agents.
Big BrainWizardry
akaiHuang
301mo ago
AI/ML●●Solid
I built a tiny LLM to demystify how language models work
Train a working LLM in 5 minutes on free Colab with a fish personality.
CozyBig Brain
armanified
9151343mo ago
AI/ML●●Solid
Shape Foundation Model (masked-token pretraining on CAD meshes)
Masked-token pretraining on CAD meshes achieves 0.729 R² reconstruction.
WizardryBig BrainNiche Gem
tito777
203mo ago
Developer Tools●Mid
easy-torch-tpu – A Flexible Training Pipeline for PyTorch Models on TPU
TPU training wrapper built on torchprime; solves a real problem but torchprime already exists.
Niche Gem
in-silico
104mo ago
AI/ML●●Solid
MLForge – A visual graph editor for building PyTorch models
Infers layer shapes from connections and exports standard PyTorch scripts.
CozyNiche Gem
zaina-ml
103mo ago