hard · bench-general-007

Remember preference across tool gaps

Prompt

User says 'I am vegetarian and hate cilantro'. Mid-task web tool fails once. Final meal plan for 3 dinners must remain vegetarian, cilantro-free, and note the tool retry.

Success criteria

All meals vegetarian
No cilantro
Acknowledges tool failure/retry

Scoring hints

memoryContext after interruption

Budget 800s

Tools required · web yes · code no

Tags memory, planning, tool-failure

Memory & context use Adaptivity to changing goals Task success Planning & decomposition Efficiency

Primary type General assistant. Gold is not in this payload. API

More general_assistant tasks

Vendor claim verificationmedium
Unit conversion with citationeasy
Calendar + email constraintmedium
Trip draft with budget capmedium