a builder's codex
codex · operators · Simon Willison · ins_willison-qwen-reasoning-overthink

Reasoning models apply maximum effort to trivial tasks unless explicitly tuned to a lower effort level

By Simon Willison · Creator of Datasette; independent AI engineering blogger · 2026-08-16 · essay · Qwen 3.8 27B is excellent, but it defaults to wildly overthinking things

Tier A · TL;DR
Reasoning models apply maximum effort to trivial tasks unless explicitly tuned to a lower effort level

Claim

Reasoning models like Qwen 3.8 27B default to the highest-effort processing setting and apply it uniformly to simple and complex tasks alike, consuming 22,276 reasoning tokens and 21 minutes of wall-clock time for a basic SVG request.

Mechanism

Reasoning models are trained on high-effort chains of thought that improve benchmark performance. Without a built-in task-complexity classifier, the model has no mechanism to distinguish a "draw a circle" prompt from a multi-step engineering problem. It applies the same depth of deliberation to both. The effort level is a parameter exposed to the user, but the default is the maximum. Teams that accept the default are paying the full reasoning cost on every request, including trivially simple ones. The correct operating posture is to start at the lowest effective effort level and escalate only when task complexity warrants it.

Conditions

Holds when: the model ships with a configurable reasoning effort parameter and the default is not calibrated to task complexity. Applies across reasoning models that expose effort levels (xhigh, medium, low, none) without guiding the user toward appropriate defaults.

Fails when: the task genuinely requires extended chain-of-thought (complex multi-step reasoning, novel problem solving, ambiguous specification). High-effort defaults are correct choices for those workloads.

Evidence

Willison tested Qwen 3.8 27B on August 16, 2026. The model exposes three reasoning effort levels: xhigh (default), medium, and low.

At the xhigh default:

"Run Qwen 3.8 27B on low or even no reasoning levels at first."

"a hilarious default. It's absolutely not a good way to run the model, especially on consumer hardware."

Signals

Counter-evidence

The behavior Willison observed is at the extreme end: 21 minutes for an SVG is a worst-case demonstration, not a median outcome. Many production tasks are neither trivially simple nor genuinely complex, and the performance benefit of medium-effort reasoning on those tasks may be worth the extra cost. Vendors may have set high defaults intentionally because most early adopters benefit from careful reasoning and are less likely to optimize for latency than for quality. The finding is model-specific to Qwen 3.8 27B's Aug 2026 release; other reasoning models calibrate effort differently. Willison is a practitioner running tests on consumer hardware, not a benchmark study across production workloads.

Cross-references

Open the interactive view → View original source → Markdown source →