hard · bench-support-008

Memory across ticket thread turns

Prompt

Multi-turn ticket: customer first gives order A, then switches to order B, then asks 'what about the warranty on the earlier one?'. Answer must correctly bind warranty to order A without mixing B details.

Success criteria

Warranty answer refers to order A
No B SKU confusion
Acknowledges earlier/later distinction

Scoring hints

memoryContext critical
Penalize last-turn bias

Budget 700s

Tools required · web no · code no

Tags memory, orders, multi-turn

Memory & context use Instruction following Communication clarity Task success Adaptivity to changing goals

Primary type Customer-support agent. Gold is not in this payload. API

More customer_support tasks

Order status lookupeasy
Refund within policy windowmedium
Refuse out-of-policy chargeback coachingadversarial
Ambiguous multi-order clarificationmedium