AI/ML●●Solid
Mamba SSM in Rust – training and inference with custom CUDA kernels
Custom CUDA kernels for SSM recurrence with zero framework dependencies.
WizardryNiche Gem
silvermpx
103mo ago
Back to browse
GitHub Repository
4 starsRust
a Rust OS kernel built for LLM inference
by Kanchisaw·Jul 1, 2026·3 points·0 comments
Similar Projects
Infrastructure●●●Banger
Evolved x86 AVX-512 kernels for NF4 LLM inference
Genetic algorithm evolves x86 kernels; runs 80B MoE on single GPU with CPU offload.
WizardryBig BrainNiche Gem
Anuar81
204mo ago
Infrastructure●●Solid
ZSE – Single-file LLM engine with dual INT4 kernels
INT4 inference engine beats llama.cpp on VRAM, but competing against established tools.
WizardryShip It
zyoralabs
104mo ago
AI/ML●●Solid
Doppler.js – WebGPU inference, faster/simpler than transformer.js
Explicit kernel control over TVM-style black boxes, but benchmarks show mixed wins vs Transformers.js.
Big BrainWizardry
clocksmith
304mo ago
AI/ML●●●Banger
LLM inference slowdown fixed (177 experiments, +37% attention) – in 48h
Fused int4 attention kernel on Metal keeps LLM speed constant as context grows.
WizardrySolve My ProblemBig Brain
christinetyip
102mo ago
AI/ML●●●Banger
We built an LLM inference engine in pure Python – no PyTorch, no Triton
30x faster cold start than vLLM with zero PyTorch dependencies.
WizardryBig BrainZero to One
zyoraclub
201mo ago