GitHub Repository

If it's on the screen, it's an API. Control any desktop app via REST + MCP. Rust.

114 starsRust

OculOS – Any desktop app as a JSON API via OS accessibility tree

Name: OculOS – Any desktop app as a JSON API via OS accessibility tree
Availability: InStock
Author: stif1337

by stif1337·Mar 7, 2026·18 points·9 comments

Visit Project View on HN

AI Analysis

●●●BangerWizardryZero to One

Accessibility tree → REST+MCP means Claude controls Spotify with zero instrumentation.

Strengths

•Elegantly side-steps screenshot fragility by shipping structured JSON directly from OS APIs.
•MCP integration works out of the box; Claude/Cursor/Windsurf adoption path is clear.
•True cross-platform (Windows, Linux, macOS) in a single Rust binary with zero runtime dependencies.

Weaknesses

•Requires accessibility permissions per app, friction for users unaware of OS-level constraints.
•Early project (12 stars, 9 commits), no battle-tested production examples beyond demo clips.

Post Description

Single Rust binary (~3 MB) that reads the OS accessibility tree and gives every UI element a REST endpoint. Click buttons, type text, toggle checkboxes — all via JSON. Works as an MCP server too, so Claude/Cursor/Windsurf can control any desktop app out of the box.

Windows + Linux + macOS. MIT licensed.