Ace is a computer autopilot that performs tasks on your desktop using your mouse and keyboard.
Ace outperforms other models on our suite of computer use tasks, which we are open-sourcing here. We're making the ace-control models available to selected partners through our developer platform.
Model Accuracy Comparison
Correct Left-Click Predictions
Click Accuracy (95% CI)
Ace is exceptionally fast! It can perform many tasks in superhuman time.
Action Prediction Latency (ms)
Ace works like we do—performing mouse clicks and keystrokes based on the screen and prompt—trained with <3 by our team of software specialists and domain experts on over a million tasks.
Ace is still learning and can make mistakes. Here are some examples of its failures:
We're just beginning. As we increase training resources, Ace will become more intelligent and capable.
Accuracy vs Training Resources
Normalized Training Resources (log scale)
Accuracy
We're launching an early version of Ace in research preview. We invite you to try Ace for yourself.