Productivity●●Solid
Glimpse, Markdown reader using Apple's on-device foundation model
On-device Apple Intelligence summaries beat sending RFCs to the cloud.
CozySlick
duman
2122d ago
Back to browse
GitHub Repository
Community model zoo + knowledge base for Apple Core AI (iOS/macOS 27): Qwen3.5 & Gemma 4 converted end-to-end, verified on-device (iPhone 17 Pro GPU/ANE), conversion gotchas, custom Metal kernels, Swift runner
65 starsSwift
I ported 11 model families to Apple's new on-device AI framework
by mlboy·Jun 12, 2026·2 points·2 comments
AI Analysis
●●●BangerWizardryBig BrainNiche Gem
11 model families ported to Core AI with verified on-device benchmarks on iPhone 17 Pro.
Strengths
- •Custom Metal kernels and conversion code enable genuine on-device inference.
- •Comprehensive benchmark table with tok/s across GPU and ANE.
- •Vision-language models (Qwen3-VL, Gemma 4 VL) included, not just text.
Weaknesses
- •Requires iOS 27/macOS 27, limiting current adoption.
- •Large models (35B MoE) Mac-only, not portable to iPhone.
Category
Target Audience
iOS/macOS developers, on-device AI practitioners, Apple Silicon users
Similar To
Off Grid · MLC Chat · Llamafile
Similar Projects
Developer Tools●●Solid
Strudel – Generate commit messages via Apple's on-device LLM
Local Apple LLM commit messages beat cloud APIs on privacy, but Copilot integrates better.
CozyNiche Gem
Mechse
4320d ago
AI/ML●Mid
On-Device vs. Cloud LLMs for Agentic Tool Calling in a Real iOS App
Empirical data from a shipped app, but it's a paper not a tool.
Niche Gem
martinovigiani
202mo ago
AI/ML●●Solid
On-device embedding and vector search for Apple Devices, built in Zig
Manually converting PyTorch models to CoreML so you don't have to call cloud APIs.
Niche GemWizardry
mcdow
202mo ago
AI/ML●●Solid
I ported OmniAID image detection model to Apple's Neural Engine
Runs OmniAID detection locally on Neural Engine instead of uploading your data to servers.
SlickBig Brain
woadwarrior01
401mo ago
AI/ML●●Solid
NeuralForge – Fine-Tune LLMs on Your Mac Using Apple Neural Engine
Fine-tune LLMs on Apple Neural Engine using reverse-engineered private frameworks — genuinely novel approach.
WizardryBig BrainNiche Gem
khaeldur
113mo ago