HN Showcase
Back to browse
GitHub Repository

The Swiss Army Knife of Offline AI. Chat, Speak, and Generate Images - Privacy First, Zero Internet. Download an LLM and use it on your mobile device. No data ever leaves your phone. Supports text-to-text, vision, text-to-image

2,428 starsTypeScript

Qwen 3.5 running on a $300 Android phone – on-device, open source

by ali_chherawalla·Mar 3, 2026·6 points·10 comments
Visit ProjectView on HN

AI Analysis

●●●BangerZero to OneWizardry

Comprehensive offline AI suite (text, vision, images) on $300 phones—genuinely complete.

Strengths
  • •True multimodal completeness: text, vision, image gen, voice, tool-calling all local.
  • •Hardware-accelerated inference (NPU on Snapdragon, Core ML on iOS) with verifiable throughput.
  • •Ships on both Google Play and App Store with 780+ GitHub stars and 2K+ downloads—proven usable.
Weaknesses
  • •Performance still constrained (5-10s per image, 7s per vision inference)—acceptable but not seamless.
  • •Competing against entrenched cloud AI; limited differentiation if user has internet access.
Category
AI/ML
Target Audience

Privacy-conscious mobile users, developers building offline-first AI features

Similar To

Ollama (desktop local LLMs) · LLaMA.cpp · llama2.c

Post Description

Qwen 3.5 Small dropped two days ago. I had it running on a mid-tier Android phone within hours.

It's great seeing the on-device AI community light up around this release. Off Grid brings it to Android: phones with 6GB RAM in the $200-300 range, ~8 tok/sec on the 2B model. Fully offline.

Text generation, vision AI, image gen, voice transcription, tool calling, document analysis — all on-device, nothing uploaded, ever. Works in airplane mode.

780+ GitHub stars. ~2,000 downloads across Android and iOS. Early days.

GitHub: https://github.com/alichherawalla/off-grid-mobile-ai

Play Store: https://play.google.com/store/apps/details?id=ai.offgridmobi...

App Store: https://apps.apple.com/us/app/off-grid-local-ai/id6759299882

Similar Projects