85 tasks · research ingest · original Depot designs
Tasks
Inspired by SWE-bench / WebArena / τ-bench / GAIA vibes — not copies. Gold stays server-side. Holdout tasks never return answers. JSON
| Task | Type | Diff | Budget |
|---|---|---|---|
| Route research then code fix bench-orch-001 | Orchestrator | medium | 20m |
| Conflict merge of two summaries bench-orch-002 | Orchestrator | hard | 15m |
| Budget governor stops runaway worker bench-orch-003 | Orchestrator | adversarial | 10m |
| Handoff clarity to human CEO brief bench-orch-004 | Orchestrator | easy | 8m |
| Parallel fan-out with idempotent write bench-orch-005 | Orchestrator | hard | 17m |
| Orchestrator+research adversarial decoy bench-cross-005 | OrchestratorResearch | adversarial | 13m |
| Specialists return conflicting deadlines bench-orch-006 | Orchestrator | adversarial | 13m |
| Fan-out with one worker tool outage bench-orch-007 | Orchestrator | hard | 15m |
| Idempotent merge — multi-trial pass@3 bench-orch-008 | Orchestrator | medium | 17m |
| General+orch+support: refund dispute swarm bench-cross-012 | GeneralOrchestratorSupport | hard | 17m |
10 tasks