HN Showcase
Back to browse
GitHub Repository

Zero-dependency Rust CLI for cross-platform GUI automation. Screenshots, window management, mouse, keyboard. JSON-in/JSON-out. Built for AI agents.

11 starsRust

GUI-tool – zero-dependency Rust CLI for desktop GUI automation

by ZachRouan·Jul 8, 2026·1 point·0 comments
Visit ProjectView on HN

AI Analysis

●●●BangerWizardryBig BrainZero to One

Grid-cell targeting beats pixel guessing and works where accessibility trees fail.

Strengths
  • •Grid-based targeting with zoom sub-cells solves agent coordinate guessing problem
  • •Zero Rust dependencies with raw OS APIs - own PNG encoder and DEFLATE
  • •Works on games, canvas apps, Flutter UIs where accessibility-tree tools fail
Weaknesses
  • •New project with only 11 stars needs real-world testing and examples
  • •Grid approach may struggle with highly dynamic or animated interfaces
Target Audience

Developers building AI agents, automation engineers

Similar To

pyautogui · xdotool · SikuliX

Similar Projects

Developer Tools●●Solid

Claude Code for Mobile GUI Automation

Splitting planner (Claude/Codex) from an orchestrator/skill layer that handles retries, rollback and stateful sessions is the project's best idea — it directly targets the brittleness of long LLM GUI workflows. The repo gives practical bits (CLI, install script, direct coordinate tap mode and unified JSON outputs), but it's early and niche: useful if you're building LLM-controlled phone automation, less interesting for general automation folks.

Big BrainNiche Gem
UgOrange
104mo ago