Back to browse
GitHub Repository

Real-time AI Safety Guardrail Kernel in C++20 & CUDA. Eradicates branch misprediction and warp divergence via pure IEEE 754 bit-masking and native FMA intrinsics.

0 starsCuda

A 100% branchless, CUDA-native AI guardrail kernel written in C++20

by PJHkorea·Jul 10, 2026·4 points·1 comment

AI Analysis

MidBold BetWizardry

Branchless CUDA guardrails sound fast, but semantic safety needs context, not just bitwise math.

Strengths
  • Eliminates branch divergence using pure IEEE 754 bit-masking and FMA intrinsics.
  • Architecture binds directly to physical memory pointers for zero-copy vector scanning.
  • Attempts to replace semantic parsing with geometric distance checks for speed.
Weaknesses
  • Bitwise masking cannot detect semantic nuance, making it useless for real jailbreaks.
  • Zero stars and no benchmarks suggest this is a theoretical blueprint, not a shipped tool.
Category
Target Audience

ML engineers building low-latency inference pipelines

Similar To

NVIDIA NeMo Guardrails · Lakera Guard · PromptInject

Similar Projects

AI/ML●●●Banger

Glq LLM quantization using E8 lattice

E8 lattice codebooks beat GPTQ at 2-4 bpw with fused CUDA kernel skipping weight materialization.

WizardryBig Brain
acd
201mo ago
AI/ML●●Solid

Mamba SSM in Rust – training and inference with custom CUDA kernels

Custom CUDA kernels for SSM recurrence with zero framework dependencies.

WizardryNiche Gem
silvermpx
103mo ago
Developer Tools●●●Banger

cuTile Rust: Safe, data-race-free GPU kernels in Rust

Extends Rust's ownership model across GPU boundary with tile-based partitioning for data-race-free kernels.

WizardryBig BrainNiche Gem
melihelibol
1061825d ago