agent-desktop

Apache-2.0 Rust CLI that lets an AI agent operate desktop apps through the accessibility tree.

Also known as Agent Desktop

What it does

agent-desktop is a CLI and C library from Vercel Labs for macOS, Windows, and Linux. Version 1.0.0 was published on October 28, 2026. The changelog dates that version 2026-10-27 and says it adds Linux support through AT-SPI and releases the integrated CLI and C library as 1.0.0. Version 1.0.2, published October 30, 2026, points the package and repository links at vercel-labs/agent-desktop. The README says a snapshot returns JSON with a ref for every element an agent can act on. The agent acts on a ref and snapshots again, with no pixel matching, and the loop stays in the calling agent. Headless ref actions go through the accessibility API without moving the pointer or taking focus. The global --headed flag allows physical input. The README lists 60 command names, 56 of them operational. The license is Apache-2.0. The README does not list a price. The documented install is npm install -g agent-desktop.

Who is agent-desktop for?

People wiring a coding agent to desktop apps on macOS, Windows, or Linux without screenshot clicking.

Tags

• open-source
• desktop
• agent