AI Can Use Your Computer Now
Summary
Kahris argues Astra represents a capability threshold for computer use, treating the screen as a programmable interface to automate complex, multi-day professional workflows.
Astra treats screens as programmable interfaces.
Unlike previous models requiring APIs, Astra assumes software interfaces are machine-operable environments, allowing it to navigate any program via the screen.
It just treats the screen itself as a programmable interface.
Astra masters long-duration professional tasks.
The model successfully executed a five-hour Adobe Premiere video cut and a five-day SimCity-style game build with high autonomy.
The model worked for five days straight
Astra achieves human parity on intelligence benchmarks.
Scoring 99.9% on ARC-AGI-3, the model surpassed human action-efficiency baselines on 96% of levels.
Astra surpassed our human action-efficiency baseline on 96% of levels
Visual inputs trigger complex 3D environments.
Astra converted a single photograph into an editable 3D Blender scene and a walkable Unreal Engine 5 environment.
One flat image became an editable 3D environment.
Keyboard input will become irrelevant.
As frontier models become faster and more performant, they will operate machines at speeds humans cannot follow.
Using a keyboard will become increasingly irrelevant.
Highlights
It is the first flagship model built around the assumption that software interfaces are machine-operable environments. It doesn’t need every application to expose a clean
Read the original ↗Save to your Sponge
Summarized with Sponge. Quotes are the author’s own words.