HN Showcase
Back to browse
llamafile 0.10.0 rebuilt, Qwen3.5, lfm2, Anthropic API

llamafile 0.10.0 rebuilt, Qwen3.5, lfm2, Anthropic API

by mzlaai·Mar 19, 2026·7 points·0 comments
Visit ProjectView on HN

AI Analysis

●●●BangerWizardrySolve My Problem

Single executable bundles models and runs everywhere — still no other tool does portable LLMs this well.

Strengths
  • •APE executable format runs natively across Windows, macOS, Linux without installation
  • •Polyglot llama.cpp build keeps pace with upstream while preserving portability features
  • •Model weights bundled directly into executables — no separate download or configuration needed
Weaknesses
  • •Vulkan GPU support still teased, not shipped — CUDA and Metal only for now
  • •Some features from older llamafile versions not yet restored in this rebuild
Category
AI/ML
Target Audience

ML engineers, developers deploying local LLMs, infrastructure teams

Similar To

llama.cpp · Ollama · LM Studio

Similar Projects

AI/ML●●Solid

Translate LLM API Calls Across OpenAI, Anthropic, and Gemini

Hub-and-spoke IR translates LLM APIs without N^2 adapter hell.

Big BrainNiche Gem
Oaklight
201mo ago
Developer Tools●●Solid

LLM Gateway for OpenAI/Anthropic Written in Golang

Runs as a single binary with embedded SQLite and zero-config start, acting as a transparent, provider-agnostic proxy that logs model, tokens, latency, cost and API key hashes while leaving full body capture opt-in. It also proxies streaming responses in real time and exposes stable JSON analytics endpoints — a practical, instrumentable way to get reproducible, audit-ready traces for real LLM traffic, though long-term value depends on how it handles provider edge-cases and SDK compatibility.

Solve My ProblemNiche GemSlick
oatmale
423mo ago