Cumulative Rollout Completion - Terminal-Bench 4.0

cumulative rollout completion

env setup agent setup agent execution verifier

resolution rate vs agent execution time

resolution rate vs cost

trial outcomes

4.0

3.0

8 tasks were removed between version 3.0 and version 4.0