Real Unreal Bench · Task 11

Play an action RPG against its spec and fix what breaks

Grok 4.7Run 1Fail

Outcome
Fail
Duration
1h 16m
Steps
300
Tokens
22.6M
Cost
$11.67

Task

An action RPG has to ship. Given a spec of its levels, world and menus, the agent plays it through the way a player would, finds the places where it breaks the spec (about nine: levels that never end, rooms and enemies out of reach, menus and controls among them) and fixes them without adding content.

Run details

Event types

  • Thoughts0
  • Messages258
  • Tool calls427
  • Commands226
  • Reads187
  • Writes14

Trace

685 events