Astra, Opus 5.5, and other Frontier Models Demonstrate Jagged Performance Across SoTA Agentic Tasks from Web Browsing to Robotics
Yangyue Wang1, Harshvardhan Sikka1, 2, Pranav Guruprasad1, Sudipta Chowdhury1
1Fig; 2Georgia Institute of Technology.
Five task spaces by description, effort and error
error threshold 0%: 0 have observed error at or above it
drag to turn · hover a point
How to readhover a dot on the island to see its task
Height: errors
Around: task content
Related tasks are grouped around the island.
Outward:
How this map is calculated
Each dot is one task. The ground is a smoothed average over nearby tasks. Green is above the error threshold.