a builder's codex
codex · operators · Simon Willison · ins_willison-reasoning-effort-nonlinear-creative

Reasoning effort levels create non-linear quality jumps in creative tasks: low and medium skip thinking entirely

By Simon Willison · Creator of Datasette; co-creator of Django; prolific LLM and agentic-engineering blogger · 2026-09-01 · essay · Claude Fable 5.1 made me a really nice animated pelican

Tier B · TL;DR
Reasoning effort levels create non-linear quality jumps in creative tasks: low and medium skip thinking entirely

Claim

In extended-thinking models, the relationship between reasoning effort setting and output quality is non-linear for creative tasks. Low and medium settings skip reasoning entirely, while maximum effort triggers explicit iterative self-correction visible in the reasoning trace. The cost difference is 33x.

Mechanism

Extended thinking allocates a token budget for the model to deliberate before producing output. The model decides, based on the task and effort setting, whether to spend that budget. For a creative task like SVG generation, the model at low or medium effort treats the task as not warranting reasoning investment and skips it entirely, producing output directly from its training distribution.

At maximum effort, the model enters explicit self-correction: it proposes an approach, evaluates it, and revises before committing. The revision is visible in the reasoning trace. Willison observed the model reconsidering leg positioning and feather structure in its trace before rendering the final SVG. The deliberation added qualitative detail not present at lower settings.

The cost non-linearity reflects this: low/medium produce approximately 2,000 tokens total at around $0.10. Maximum effort produced 65,927 tokens at $3.30. The jump from high to max is roughly 25x in tokens and 18x in cost.

Conditions

Holds when: the task requires deliberate aesthetic judgment or iterative refinement (visual design, creative writing, complex argument construction). The task must have enough open-ended decision surface that additional reasoning produces genuine revision, not just confirmation of an initial answer.

Fails when: the task is retrieval or structured-output oriented. For factual lookups, classification, or constrained-format tasks, reasoning effort may not change the output meaningfully at any setting. The model allocates reasoning to tasks where it perceives deliberation as worth the cost.

Evidence

Willison tested Claude Fable 5.1 with a single prompt asking for an animated SVG pelican at all five effort levels (low, medium, high, xhigh, max). Results:

The max-effort pelican included a hat, a fish basket, and refined feather detail not present at lower settings. Willison's read of the reasoning trace showed explicit mid-generation course corrections.

"I'm adding a darker tip region to represent the primary feathers, then reconsidering the trailing edge to include scalloped feather curves instead of one smooth line for a more natural look."

Signals

Counter-evidence

The 33x cost premium makes max reasoning effort impractical for production use cases with high query volume. The quality gain is task-dependent and may not justify the cost for most real applications. Additionally, there is a risk of overthinking on simpler tasks, where extensive reasoning produces overengineered output. Willison's test used a single creative prompt; generalizability to other creative tasks is plausible but unverified.

Cross-references

Open the interactive view → View original source → Markdown source →