HN Showcase
Back to browse
GitHub Repository
59 starsPython

Haindy, a CLI that gives coding agents computer use

by fkeegan·Apr 16, 2026·2 points·0 comments
Visit ProjectView on HN

AI Analysis

●●●BangerWizardrySolve My Problem

Gives CLI coding agents screen control to test UIs like a human would.

Strengths
  • •Enables CLI agents to interact with mobile and desktop apps via screenshots.
  • •Integrates directly with Claude Code and Codex without complex configuration setup.
Weaknesses
  • •Coordinate-based interaction is brittle compared to DOM or accessibility tree access.
  • •Depends on external paid AI providers for the actual computer use logic.
Target Audience

Developers using CLI coding agents

Similar To

OpenAI Computer Use · Browser Use · Anthropic Computer Use

Post Description

I built HAINDY, a CLI that gives coding agents computer use across desktop, Android, and iOS.

You install it as a normal CLI tool and can opt to install skills for it on Claude Code, Codex and OpenCode.

It gives agents human-like control of devices. When the agent instructs it to click a button there's a screenshot + coordinate based computer use loop. No DOM or accessibility is used.

I built it because I wanted agents to test things the way a human would, watching the screen and using it from a user perspective.

Would love feedback on onboarding, real use cases, and whether this fits naturally into existing agent workflows.

Similar Projects

Developer Tools●●Solid

Cc-connect – Remote control Claude Code from your favorite chat app

Multi-platform bridge for Claude Code via chat, but only Claude fully working.

Ship ItSolve My Problem
cg33
123mo ago
Developer Tools●Mid

Automate Mac with Codex: macOS Control MCP Demo

Lets agents actually see the screen and act on it by returning OCR text with pixel coordinates and offering commands like click_at, type_text, and press_key. You can run it instantly with npx (it auto-creates a Python venv and hooks into Apple Vision/Quartz), and there are ready-made integration snippets for Claude, VS Code, and Cursor — a pragmatic, technically neat tool for closed-loop agent UI work. It’s limited to macOS 13+ and Apple APIs, but within that niche it removes a lot of friction.

WizardryNiche Gem
peterhddcode
104mo ago