Real Unreal Bench · Task 11
Play an action RPG against its spec and fix what breaks
Gemini 4 ArgonRun 1Fail
- Outcome
- Fail
- Duration
- 1h 55m
- Steps
- 147
- Tokens
- 63.5M
- Cost
- $22.31
Task
An action RPG has to ship. Given a spec of its levels, world and menus, the agent plays it through the way a player would, finds the places where it breaks the spec (about nine: levels that never end, rooms and enemies out of reach, menus and controls among them) and fixes them without adding content.
Run details
Event types
- Thoughts147
- Messages0
- Tool calls331
- Commands91
- Reads138
- Writes101
- Done1