Computer Control

Let Otta look at the screen and drive the mouse and keyboard, for software with no other interface.

Computer control lets Otta take screenshots, move the mouse, click and type — operating software the way a person sitting at your machine would.

Off by default.

Turning it on

Settings → Computer Control → toggle on.

Using it

Describe the goal in the conversation, not each step:

Open the reporting app and export this month's data

Otta screenshots, works out what is on screen, decides the next action, and loops until it finishes. You can watch every step and interrupt at any point.

When to use it

Only when the software has no other interface:

  • Legacy line-of-business software with a GUI and nothing else
  • Systems with no export, where you can only page through the screen
  • Repetitive work in a client with no command line

Everything else has a faster route: file work goes straight through Otta, web work through Browser Control.

Recommendations

  • Close unrelated windows first to reduce stray clicks
  • Back up anything important
  • Turn it off while handling online banking or password managers
  • Watch it the first few times

Limits

Scheduled tasks cannot use computer control. It is not available unattended.

Troubleshooting

I turned it on but Otta still says it cannot

Send another message. Capability toggles take effect from the next turn.

It clicked the wrong thing

Interface changes — dialogs, resolution, themes — affect its judgement. Be more specific, naming the window title or the button text.

It gets stuck partway

Interrupt it and break the task down — one screen's worth of operations at a time rather than a long flow across several windows.