GitHub adds computer-use preview to Copilot CLI and desktop app
GitHub released a public preview of computer use that lets Copilot agents read, click, type, scroll, and drag inside macOS and Windows applications, including legacy GUI software without APIs.
What changed
GitHub enabled computer use in public preview for Copilot CLI and its desktop app, allowing agents to operate macOS and Windows applications through accessibility trees and screenshots.
Agents can now interact with older GUI-only programs that lack APIs, command-line interfaces, or MCP integration by reading content and performing mouse and keyboard actions.
Enterprise policy can block the feature or restrict bypass of approval prompts; saved approvals persist across CLI and desktop sessions on the same machine but require separate stop actions.


