Gaming●Mid
Distance Ruler
Pixel-distance estimation game when dozens of perception-test games already exist online.
Crowd Pleaser
nookeshkarri7
3011d ago
Back to browse
RBF-Attention – Trading dot-products for Euclidean distance
by 4rtemi5·Apr 7, 2026·1 point·1 comment
AI Analysis
●●●BangerBig BrainWizardry
Replaces dot-product attention with Euclidean distance to stop vector magnitude bullying.
Strengths
- •Identifies specific "magnitude bullying" flaw in standard scaled dot-product attention math.
- •Includes custom Triton kernel for memory-efficient implementation on existing hardware.
- •Trained a causal LM from scratch to validate empirical results against standard attention.
Weaknesses
- •Experimental nature means no production libraries or pre-trained models available yet.
- •Hardware acceleration for dot-products is ubiquitous, distance might be slower on GPUs.
Category
Target Audience
ML researchers, LLM engineers
Similar To
FlashAttention · xFormers · Standard Transformers
Similar Projects
Social●Mid
League of Early Adopters – Give product feedback, get product feedback
Reciprocal feedback sounds fair, but BetaList and HN already solve this better.
Ship It
sarim
1128d ago
Developer Tools●Mid
A minimal linear algebra library in pure Go
Gonum already does linear algebra in Go with more features and active maintenance.
Cozy
igomeza
504d ago
Other●Mid
The Economics of Builder Saturation in Digital Markets
Economic theory paper, not a tool — interesting model but nothing to actually use.
Big BrainNiche Gem
armcat
102mo ago
Developer Tools●●Solid
OpenTangl – Autonomous AI dev engine for multi-repo products
Cross-repo dependency resolution is clever; but autonomous code agents are a crowded, uncertain category.
Big BrainShip It
8con
103mo ago
AI/ML●●●Banger
Leviathan, A world where AI agents write the laws and govern themselves
Self-governing AI agent society with oracle-signed rules and constitutional evaluation framework.
Zero to OneRabbit HoleBig Brain
chenyusu
313mo ago