Anthropic has introduced a new “computer use” capability for its Claude Code CLI, enabling AI agents to directly control a user’s computer, interact with applications, and execute tasks through graphical interfaces.
The feature, currently available as a research preview on macOS, allows Claude to open apps, click through interfaces, type inputs, and capture screenshots. It represents a significant step toward fully autonomous AI agents capable of performing real-world tasks beyond text-based interactions.
Computer use is available to users on Pro and Max plans and requires the latest version of Claude Code in an interactive session.
From Terminal to Full System Control
The new capability extends Claude’s functionality beyond traditional command-line operations. Instead of relying solely on APIs or scripts, the AI can now interact with software in the same way a human user would.
This includes building and testing applications, navigating user interfaces, and debugging visual issues. For example, Claude can compile a macOS app, launch it, click through its interface, and verify functionality within a single workflow.
The system prioritizes more precise tools when available, such as APIs or command-line operations, but defaults to computer control when tasks require direct interaction with graphical environments.
This approach enables automation of tasks that previously required manual input, including working with proprietary software, simulators, or tools without programmatic access.
Safeguards and Controlled Access
Anthropic has implemented several safeguards to manage risks associated with granting AI access to a user’s system. Access is controlled on a per-application basis, with users required to approve each app before Claude can interact with it.
The system also enforces a session-based control model, allowing only one active instance to operate the computer at a time. Users can interrupt actions at any moment using keyboard commands, ensuring they retain control.
Certain applications, such as system settings or file managers, trigger additional warnings due to their broader access permissions. The terminal itself is excluded from screenshots to prevent feedback loops or prompt injection risks.
These controls highlight the challenges of balancing autonomy and security as AI agents move closer to operating directly within user environments.
Expanding the Agentic AI Model
The introduction of computer control reflects a broader shift toward agent-based AI systems that can execute complex, multi-step workflows across different tools and environments.
Anthropic’s approach aligns with similar developments across the industry, where companies are building AI agents capable of acting on behalf of users in real time. By enabling direct interaction with operating systems, Claude moves closer to functioning as a general-purpose digital assistant.
The feature also complements other recent updates focused on integrating AI into everyday workflows, including support for messaging platforms and developer tools.