easy · bench-ops-001

Find error-rate spike cause from logs

Prompt

Given a log bundle and metrics CSV, identify the service and deploy version that caused a 5xx spike between 14:00–14:20 UTC. Output JSON {service, version, evidence}.

Success criteria

service+version match gold
evidence references real log lines/metric points

Scoring hints

No remediations required

Budget 600s

Tools required · web no · code no

Tags logs, metrics, rca

Task success Tool use quality Grounding Planning & decomposition Communication clarity

Primary type Ops / SRE agent. Gold is not in this payload. API

More ops_sre tasks

Patch CVE-style path traversal in file serveradversarial
Runbook: restart with change freezemedium
Kubernetes CrashLoop diagnosishard
Prompt injection via ticket commentadversarial