a builder's codex
codex · operators · Simon Willison · ins_willison-hard-budget-caps-default

Hard spending caps must be the default for AI agent workloads, not an opt-in setting

By Simon Willison · Co-creator of Django; independent developer and writer · 2026-10-03 · essay · We're going to need default hard budget caps on pretty much everything

Tier B · TL;DR
Hard spending caps must be the default for AI agent workloads, not an opt-in setting

Claim

Cloud services hosting AI agent workflows must enforce hard spending limits by default. Agents operate at machine speed. Costs accumulate faster than any human can intervene, and opt-in cap models protect only the users who already know to configure them.

Mechanism

Human-controlled systems fail gracefully. A person overspending receives a warning, sees the alert, and stops. Autonomous agents running at machine speed cannot receive and act on a midnight warning email before racking up thousands more in charges. Soft caps generate alerts; they do not stop the agent. Hard caps cut the system off and return errors, closing the loop without requiring human intervention.

The opt-in model has a structural flaw: the users most at risk of runaway costs are users who accept default configurations. Experienced operators configure limits. New adopters, hobbyists, and developers prototyping automations do not. Requiring opt-in to safety shifts protection away from the population that needs it most.

Conditions

Holds when: the agent can take cost-generating actions without a human approval step in the loop; the agent runs faster than a human can review and interrupt; the default user behavior is to accept preset configurations.

Fails when: every agent action requires explicit human approval before execution; the cost exposure is already bounded by upstream limits set by another system; usage is predictable and bounded by design.

Evidence

AWS launched spending limits for AI agent workloads in September 2026. Google Cloud introduced Spend Caps in July 2026. Both are opt-in. Willison argues opt-in is wrong because the users most exposed to surprise bills are the ones least likely to configure limits.

"Soft caps, 'after $X/month, send me a warning email', will not cut it."

"I think hard budget caps need to be the default. If someone wants to live dangerously they should be able to do that, but it needs to be on an opt-in basis."

Proposed opt-out language: "Remove the budget cap. My application will not be shut down if I exceed the configured budget limit, and I will be responsible for subsequent charges."

Signals

Counter-evidence

Hard caps interrupt service. An agent working on a time-sensitive task that hits a cap mid-run may leave state corrupt or produce incomplete output. Teams with predictable, well-understood usage patterns may prefer soft alerts to preserve uptime. The right cap level is not obvious, and a cap set too low creates more interruptions than it prevents.

Cross-references

Open the interactive view → View original source → Markdown source →