GitHub enabled computer use in public preview for Copilot CLI and its desktop app, allowing agents to operate macOS and Windows applications through accessibility trees and screenshots.
Agents can now interact with older GUI-only programs that lack APIs, command-line interfaces, or MCP integration by reading content and performing mouse and keyboard actions.
Enterprise policy can block the feature or restrict bypass of approval prompts; saved approvals persist across CLI and desktop sessions on the same machine but require separate stop actions.
GitHub recommends using direct tools such as APIs or filesystem commands first because desktop interaction can repeat actions or stall on dynamic interfaces.