Single Rust binary (~3 MB) that reads the OS accessibility tree and gives every UI element a REST endpoint. Click buttons, type text, toggle checkboxes — all via JSON.
Works as an MCP server too, so Claude/Cursor/Windsurf can control any desktop app out of the box.Windows + Linux + macOS. MIT licensed.
▲I wonder whether this requires particular GUI toolkits to be used, such as WFC. In any GUI there are enough "bad boy" toolkits which just "draw lines" and thus are not accessible at all.
reply