An agent must click through an old desktop app that has no API. What can you design?
Why C is the answer
Computer use
Computer use lets an agent operate apps and websites through their interface, which fits software with no API.
In detail
- Computer use lets an agent operate an app with no API.
- Prefer an API or connector whenever one exists.
Use case
An illustrative scenario, not a real incident.
An old ordering app has no API. Computer use lets an agent work through its screens like a person.
See it in different ways
flowchart TD
A{"What must the agent reach?"} -->|"Tools with an open standard"| B["Model Context Protocol"]
A -->|"A service with a connector"| C["Connector"]
A -->|"An app with no API"| D["Computer use"]mindmap
root((Integration))
Has a connector
Connector
Open tool standard
Model Context Protocol
No API
Computer use
Azure AI services
Foundry Toolsflowchart TD
Q{"Is there an API?"}
Q -->|"Yes"| A0["Use the API or a connector"]
Q -->|"No"| A1["Computer use"]Key point: Computer use works where no API exists.
Why the other options are wrong
- A. A longer system prompt listing each of the steps in the old desktop app
- A list of steps does not click anything.
- B. A sensitivity label on the app
- A label classifies data.
- D. A declarative agent with no tools
- With no tools, it cannot act.