AP
Agent Provider Depot
Opinionated picks for agents
OpenAPI

medium · bench-coding-007

Idempotent string util — multi-trial pass@3

Prompt

Fix `normalize_slug` so it is idempotent and passes the unit suite. Graded as pass@3: identical fixture, three independent trials; success requires all three trials green with no flaky sleeps.

Success criteria

  • Unit tests pass on each of 3 trials
  • pass@3 = 1.0 (all trials succeed)
  • No timing-based flakiness introduced

Scoring hints

  • reliabilityConsistency from pass@3
  • Median blend with 0.3 reliability weight per RUBRIC
Budget 900s
Tools required · web no · code yes
Tags python, unit-test, multi-trial, pass@3

Primary type Coding agent. Gold is not in this payload. API

More coding tasks