| Fix off-by-one in pagination helper bench-coding-001 | Coding | easy | 10m |
| Add retry with jitter to HTTP client bench-coding-002 | Coding | medium | 15m |
| Resolve flaky race in concurrent cache bench-coding-003 | Coding | hard | 30m |
| Implement SQL migration and backfill safely bench-coding-004 | Coding | hard | 25m |
| Patch CVE-style path traversal in file server bench-coding-005 | CodingOps / SRE | adversarial | 20m |
| Minimal fix from failing CI log only bench-coding-006 | Coding | medium | 20m |
| Multi-hop factual short answer bench-research-001 | Research | easy | 10m |
| Synthesize conflicting sources bench-research-002 | Research | medium | 15m |
| Unknowable claim abstention bench-research-003 | Research | adversarial | 5m |
| Literature map with citation graph bench-research-004 | Research | hard | 30m |
| Vendor claim verification bench-research-005 | ResearchGeneral | medium | 12m |
| Find error-rate spike cause from logs bench-ops-001 | Ops / SRE | easy | 10m |
| Runbook: restart with change freeze bench-ops-002 | Ops / SRE | medium | 10m |
| Kubernetes CrashLoop diagnosis bench-ops-003 | Ops / SRE | hard | 25m |
| Prompt injection via ticket comment bench-ops-004 | Ops / SRE | adversarial | 10m |
| Rollback decision under partial metrics bench-ops-005 | Ops / SRE | medium | 12m |
| Order status lookup bench-support-001 | Support | easy | 5m |
| Refund within policy window bench-support-002 | Support | medium | 8m |
| Refuse out-of-policy chargeback coaching bench-support-003 | Support | adversarial | 5m |
| Ambiguous multi-order clarification bench-support-004 | Support | medium | 10m |
| Escalation handoff package bench-support-005 | Support | hard | 12m |
| Simple aggregation SQL bench-data-001 | Data | easy | 7m |
| Join with filter footgun bench-data-002 | Data | medium | 12m |
| Misleading chart correction bench-data-003 | Data | medium | 10m |
| Warehouse cost anomaly bench-data-004 | Data | hard | 20m |
| Poisoned schema docstring bench-data-005 | Data | adversarial | 8m |
| Extract product price from static page bench-browser-001 | Browser | easy | 5m |
| Multi-step checkout on replica store bench-browser-002 | Browser | medium | 15m |
| Dismiss cookie/modal noise bench-browser-003 | Browser | medium | 12m |
| OSWorld-like file rename via GUI bench-browser-004 | Browser | hard | 20m |
| Phishing 'download update' interstitial bench-browser-005 | Browser | adversarial | 13m |
| Slot-fill appointment booking bench-voice-001 | Voice | easy | 7m |
| ASR noise repair bench-voice-002 | Voice | medium | 8m |
| Barge-in cancel bench-voice-003 | Voice | hard | 7m |
| Social-engineer password reset bench-voice-004 | Voice | adversarial | 7m |
| Route research then code fix bench-orch-001 | Orchestrator | medium | 20m |
| Conflict merge of two summaries bench-orch-002 | Orchestrator | hard | 15m |
| Budget governor stops runaway worker bench-orch-003 | Orchestrator | adversarial | 10m |
| Handoff clarity to human CEO brief bench-orch-004 | Orchestrator | easy | 8m |
| Parallel fan-out with idempotent write bench-orch-005 | Orchestrator | hard | 17m |
| Unit conversion with citation bench-general-001 | General | easy | 5m |
| Calendar + email constraint bench-general-002 | General | medium | 10m |
| Trip draft with budget cap bench-general-003 | General | medium | 13m |
| Follow nested output format bench-general-004 | General | easy | 3m |
| Mid-task change of destination bench-general-005 | General | hard | 12m |
| Code+research: implement from paper abstract bench-cross-001 | CodingResearch | hard | 25m |
| Support+data: explain bill spike bench-cross-002 | SupportData | medium | 13m |
| Browser+ops: status page incident note bench-cross-003 | BrowserOps / SRE | medium | 10m |
| Voice+support: payment method update bench-cross-004 | VoiceSupport | hard | 15m |
| Orchestrator+research adversarial decoy bench-cross-005 | OrchestratorResearch | adversarial | 13m |
| Idempotent string util — multi-trial pass@3 bench-coding-007 | Coding | medium | 15m |
| Conflicting PR review instructions bench-coding-008 | Coding | adversarial | 20m |
| Recover from broken linter tool output bench-coding-009 | Coding | hard | 17m |
| Hallucination trap: plausible fake DOI bench-research-006 | Research | adversarial | 7m |
| Source conflict with recency constraint bench-research-007 | Research | hard | 15m |
| Multi-hop company fact — multi-trial pass@3 bench-research-008 | Research | medium | 13m |
| Error spike RCA — multi-trial pass@3 bench-ops-006 | Ops / SRE | medium | 15m |
| Cascading tool failure during incident bench-ops-007 | Ops / SRE | hard | 20m |
| Conflicting freeze vs SEV-1 page bench-ops-008 | Ops / SRE | adversarial | 10m |
| Policy refund decision — multi-trial pass@3 bench-support-006 | Support | medium | 12m |
| Injection in customer chat message bench-support-007 | Support | adversarial | 7m |
| Memory across ticket thread turns bench-support-008 | Support | hard | 12m |
| Revenue by cohort SQL — multi-trial pass@3 bench-data-006 | Data | medium | 12m |
| Tool failure then poisoned retry hint bench-data-007 | Data | adversarial | 10m |
| Causal claim vs correlation caution bench-data-008 | Data | hard | 15m |
| Prompt injection in page microcopy bench-browser-006 | Browser | adversarial | 10m |
| Form submit under flaky network bench-browser-007 | Browser | hard | 15m |
| Table scrape — multi-trial pass@3 bench-browser-008 | Browser | medium | 12m |
| Appointment booking — multi-trial pass@3 bench-voice-005 | Voice | medium | 10m |
| Conflicting ASR vs DTMF intent bench-voice-006 | Voice | adversarial | 8m |
| Hold context across transfer handoff bench-voice-007 | Voice | hard | 8m |
| Refuse payout diversion scam bench-voice-008 | Voice | adversarial | 7m |
| Specialists return conflicting deadlines bench-orch-006 | Orchestrator | adversarial | 13m |
| Fan-out with one worker tool outage bench-orch-007 | Orchestrator | hard | 15m |
| Idempotent merge — multi-trial pass@3 bench-orch-008 | Orchestrator | medium | 17m |
| System vs user conflicting tone rules bench-general-006 | General | adversarial | 5m |
| Remember preference across tool gaps bench-general-007 | General | hard | 13m |
| Structured checklist — multi-trial pass@3 bench-general-008 | General | easy | 5m |
| General+research: vendor rumor triage bench-cross-006 | GeneralResearch | hard | 12m |
| General+coding: clarify then patch bench-cross-007 | GeneralCoding | medium | 20m |
| General+browser: compare two product pages bench-cross-008 | GeneralBrowser | medium | 13m |
| General+data: executive KPI digest bench-cross-009 | GeneralData | medium | 15m |
| General+ops: incident tweet vs internal truth bench-cross-010 | GeneralOps / SRE | adversarial | 10m |
| General+voice: schedule then email summary bench-cross-011 | GeneralVoice | hard | 15m |
| General+orch+support: refund dispute swarm bench-cross-012 | GeneralOrchestratorSupport | hard | 17m |