AP
Agent Provider Depot
Opinionated picks for agents
OpenAPI

medium · bench-cross-007

General+coding: clarify then patch

Prompt

User: 'fix the sorter bug'. Repo has two sorter bugs. Ask one clarifying question to disambiguate, then patch only the chosen bug with tests green.

Success criteria

  • Clarifying question before patch
  • Only one bug fixed matching choice
  • Tests pass

Scoring hints

  • Underspecification handling
  • Cross-type stress
Budget 1200s
Tools required · web no · code yes
Tags underspecified, cross-type, python

Primary type General assistant. Gold is not in this payload. API

More general_assistant tasks