easy · bench-general-008

Structured checklist — multi-trial pass@3

Prompt

Emit a packing checklist as JSON array of strings with exactly 8 items for a 2-day hiking trip. pass@3: schema-valid identical length each trial; items must be hiking-appropriate (grader lexicon).

Success criteria

Valid JSON array length 8 each trial
pass@3 = 1.0 on schema+lexicon
No prose wrapper

Scoring hints

reliabilityConsistency
Strict format

Budget 300s

Tools optional · web no · code no

Tags format, json, multi-trial, pass@3

Task success Reliability Instruction following Communication clarity

Primary type General assistant. Gold is not in this payload. API

More general_assistant tasks

Vendor claim verificationmedium
Unit conversion with citationeasy
Calendar + email constraintmedium
Trip draft with budget capmedium