AI/ML●●●Banger
Llm.sql – Run a 640MB LLM on SQLite, with 210MB peak RSS and 7.4 tok/s
SQLite-based LLM inference hitting 210MB RSS beats OS paging with deterministic memory control.
WizardryBig BrainNiche Gem
aldielshala
822mo ago
Back to browse
Goku – WASM (wllama)-powered LLM inference and model manager
by userfrom1995·Jul 15, 2026·2 points·0 comments
AI Analysis
●●SolidCozy
Local LLM inference in the browser using wllama when Ollama requires a server.
Strengths
- •Zero-server architecture ensures complete privacy for sensitive chat data and prompts.
- •Direct HuggingFace integration simplifies the model download and management workflow.
Weaknesses
- •Browser-based inference performance lags significantly behind native desktop alternatives.
- •Model management features are basic compared to established local runners like LM Studio.
Category
Target Audience
Privacy-focused developers and local AI enthusiasts
Similar To
LM Studio · Ollama · WebLLM
Similar Projects
Security●●●●Gem
We Built Private Post-Training and Inference for Frontier Models
First multi-GPU TEE stack for training trillion-parameter models with under 10% overhead.
WizardryBold BetZero to One
oscarmoxon
714mo ago
AI/ML●●●Banger
I wrote an LLM inference engine in pure Go – 48 tok/s zero dependencies
Pure Go LLM inference, zero dependencies, 48 tok/s—genuinely novel for Go ecosystem.
Zero to OneWizardryBig Brain
computerex
204mo ago
AI/ML●●●Banger
EdgeRunner – run GGUF models with Swift and Metal
Pure Swift inference engine beats llama.cpp without any C++ bindings.
WizardryZero to One
karc14
209d ago
Developer Tools●●Solid
Ext-Infer – Native LLM Inference and Embeddings for PHP
In-process LLM inference in PHP beats the usual Python sidecar pattern.
Big BrainNiche Gem
eamann
201mo ago
AI/ML●●Solid
WebGPU LLM inference comprehensive benchmark
Sequential-dispatch methodology corrects 20x overestimation in prior WebGPU benchmarks.
Big BrainNiche Gem
yu3zhou4
223mo ago