RBF-Attention – Trading dot-products for Euclidean distance

Raytention is a new attention mechanism that solves the bloated k-v cache VRAM problem. Raytention utilizes signals built from the context to provide the model with the attention it needs at a much lower VRAM cost.

A list of AI/LLM R&D Projects where AI helps me with ideas and research

0ns zero-copy, autograd-free hybrid guide layer (Pre-Transformer Packet Rectifier). Uses viscous Burgers' & Vorticity under FNG V3 to pre-rectify high-order skewness & stream clean tensor manifolds straight into LLM Attention.

Hardware barrier-free distributed computing plane (FNG V3) fusing Burgers' viscous dissipation and moment correction directly into XLA registers to pre-rectify tensor skewness & minimize latency spikes inside distributed LLM attention rails.