# Computer use for every coding agent

Agents in ace can use the apps on your computer, not just your terminal. They work in the background, without taking your mouse or keyboard, and every session shows who is in control.

- Agents read apps through accessibility, then click and type
- You keep using your computer while they work
- A live view of every app an agent is driving
- One switch turns it on; you choose apps agents can't use

## Your apps, used in the background

Coding agents are good at code and blind to everything else: the simulator that shows the bug, the design tool with the spec, the settings screen a test depends on. ace gives every agent the same computer-use tools, whichever CLI runs it, so Claude Code, Codex, Cursor and the rest can open an app, read what is on screen and act on it.

Agents read each app through the system's accessibility interface, so they see real buttons, fields and labels instead of guessing from pixels. They work in the background: your mouse and keyboard stay yours while an agent fills a form in another app.

## You stay in control

Every app an agent is using shows in ace with the agent's name beside it, a live view, and Take over and Stop. Take over hands the app back to you mid-task; Stop ends the agent's session with it at once.

Computer use is off until you turn it on, with one switch. You decide which apps agents can never use, such as mail or a password manager, and ace refuses those apps whatever the agent asks.

## Permissions stay with your CLI

ace never adds its own approval layer. Each agent's CLI decides what runs, in the permission mode you already chose for it, and asks you the way it always does. When an agent waits on an approval, its thread says Approve, on your desktop and on your phone.

## MCP tools

`screen_apps`, `screen_state`, `screen_act`, `screen_display`

## Questions

### Can an agent use my computer while I am working?

Yes. Agents act through accessibility in the background, so they don't move your pointer or type into the app you are using. Each session shows in ace with Take over and Stop.

### Can I keep agents out of some apps?

Yes. Choose the apps agents can't use, and ace refuses them whatever an agent asks. Computer use stays off until you turn it on.

### Which agents can use computer use?

Every agent ace runs: Claude Code, Codex, Cursor, OpenCode, Antigravity, Pi and any ACP agent. They all get the same MCP tools.

Page: https://acehq.dev/features/computer-use/
