← all trials
Trial T01 · round 2 · 12 models tried

Fix the failing test: gpt-5-mini did it for $0.0009.

A slugify function with a bug. Fix the bug - not the test. A model passes this trial only when every test goes green — retries are included in the price, and the clock runs until done.

Cheapest to green
gpt-5-mini$0.0009 · x1
Fastest to green
gpt-5.45s · $0.0021
ModelVerdictTriesTimeCost to doneTokens
gpt-5-miniGREENx16s$0.0009382
claude-haiku-4-5GREENx16s$0.0021647
gpt-5.4GREENx15s$0.0021326
claude-sonnet-4-6GREENx15s$0.0023372
gpt-5.1GREENx15s$0.0023342
gpt-5.2GREENx16s$0.0023338
claude-sonnet-5GREENx17s$0.0029503
gpt-5GREENx15s$0.0030351
claude-opus-4-8GREENx16s$0.0033492
gpt-5.5GREENx15s$0.0035304
gpt-4.1GREENx16s$0.0042429
claude-fable-5REFUSEDx630s$0.00882784
time to green — this trialfull width = 30s
gpt-5.45s · $0.0021
gpt-5.55s · $0.0035
gpt-55s · $0.0030
claude-sonnet-4-65s · $0.0023
gpt-5.15s · $0.0023
gpt-4.16s · $0.0042
claude-opus-4-86s · $0.0033
gpt-5-mini6s · $0.0009
gpt-5.26s · $0.0023
claude-haiku-4-56s · $0.0021
claude-sonnet-57s · $0.0029
claude-fable-530s · $0.0088 · REFUSED

Green row = cheapest to done · blue time = fastest to done. REFUSED = the model declined the task (a failure mode token prices never show). claude-fable-5's line is high-variance: follow-up probes saw it stochastically refuse benign coding prompts it had previously attempted. One trial per model per round; replies capped at 2,048 output tokens uniformly. Costs metered per session by cerver.

THE EXACT PROMPT EVERY MODEL RECEIVED
The file `solution.py` below has a bug: `test_unicode_dash` fails.
Fix the BUG (do not change test semantics). Return the COMPLETE fixed
`solution.py` in one ```python fenced block, nothing else.

```python
import re
import unicodedata

def slugify(text):
    text = unicodedata.normalize("NFKD", text)
    text = text.encode("ascii", "ignore").decode("ascii")
    text = text.lower()
    text = re.sub(r"[^a-z0-9]+", "_", text)   # BUG lurks around separators
    return text.strip("_")
```
Tests it must pass:
```python
def test_unicode_dash():
    assert slugify("héllo — wörld") == "hello-world"
def test_spaces():
    assert slugify("A  B") == "a-b"
def test_empty():
    assert slugify("") == ""
def test_idempotent():
    assert slugify(slugify("Foo Bar")) == slugify("Foo Bar")
```
THE TESTS — RUN THEM YOURSELF
from solution import slugify

def test_unicode_dash():
    assert slugify("héllo — wörld") == "hello-world"

def test_spaces():
    assert slugify("A  B") == "a-b"

def test_empty():
    assert slugify("") == ""

def test_idempotent():
    assert slugify(slugify("Foo Bar")) == slugify("Foo Bar")
Make your own trial
your task, your tests, any model — free tier, no card