Jam Storyteller – Attention? Memory Is All You Need
Transformer without multiplications: 262K ops reduced to additions via algebraic mixing matrix.
Clifra
Geometric Algebra rotors replace matrix multiplications for 100% accuracy on 13-hop reasoning.
ML researchers, AI engineers working on reasoning and symbolic tasks
Geometric Deep Learning libraries · PyTorch Geometric · JAX
I started this because I was frustrated with how standard linear layers "smear" the data manifold. I wanted to see if using Rotors—which are intrinsically constrained to preserve distances and angles—could fix this.
So far, this approach has enabled: - 100% accuracy on 13-hop reasoning (CLUTRR) with ~300K params. Rotor composition happens to be algebraically isomorphic to logical transitivity. - Deterministic symbolic regression in ~23 seconds, skipping genetic algorithms entirely. - A custom closed-form algebraic kernel for the exponential map to bypass slow matrix exponentials.
I'm currently using this core to build a Geometric Turing Machine for ARC-AGI. It's still a work in progress, but the core framework is solid.
Take a look and let me know what you think! (https://github.com/Concode0/Versor)
Transformer without multiplications: 262K ops reduced to additions via algebraic mixing matrix.
Clean tangram-style daily puzzle, but nothing technically novel here.
Knowledge graph traces beat vector similarity for multi-hop reasoning queries.
Pure Rust autodiff + GPU math avoids C++ FFI hell, but matmul claim needs apples-to-apples benchmarks.
Single-pass analytical fitting vs gradient descent—trade-offs unclear on real workloads.
Fits a multi-arch Matrix rain demo in 2KB, beating the official hello-world on size.