Skip to content
VibeCodeBench

VS ·Pelican on a Bike

Opus 5.5 effort ladderNames hidden. Which is which?

One model, five effort levels, the same pelican prompt.

Is it fair?

One AI at different effort levels.

More thinking is not always better: at max effort it never wrote the file, in 2 tries.

  • Different effort
  • Agents only
  • Has failed tries

Same model, different effort on purpose: low, medium, high, xhigh and max. Medium worked on try 1 and broke on try 2, so try 1 is the one shown. Max never wrote a file in 2 tries: each time it hit the output limit twice (a session limit cut the first try; the second was stopped by hand). Low also has 2 tries on record (both work); high and xhigh have one each.

What these mean
Different effort
The runs used different effort steps.
Agents only
All runs used coding agents.
Has failed tries
At least one run did not produce a working demo. Failures stay on the record.

Each run

The benchmark

The classic: an animated SVG pelican pedaling a bicycle that really works.

Try this: Ring the bell, then drag the speed slider.

I keep the exact prompts private for now. See it in the gallery.

Make your own comparison

More comparisons