Prompt
From fixture logs, identify the deploy SHA that caused a 5xx spike. Run three independent trials (pass@3); root-cause SHA must match gold each time.
Success criteria
- Correct SHA on all 3 trials
- pass@3 = 1.0
- Evidence quote from logs
Scoring hints
- Production-type reliability overweight
- No guessing without log cite
Budget 900s
Tools required · web no · code no
Tags logs, rca, multi-trial, pass@3
Primary type Ops / SRE agent. Gold is not in this payload. API