a builder's codex
codex · operators · Tom Tunguz · ins_tunguz-fat-middle-demand-distribution

AI intelligence demand follows a normal distribution, not a pyramid; mid-tier models dominate commercial spending because enterprise requirements are stable while AI costs fall exponentially

By Tom Tunguz · General Partner, Theory Ventures · 2026-09-23 · essay · The Most Important Market in AI Is the Middle

Tier B · TL;DR
AI intelligence demand follows a normal distribution, not a pyramid; mid-tier models dominate commercial spending because enterprise requirements are stable while AI costs fall exponentially

Claim

The economic center of gravity in AI is not at the frontier. Mid-tier models capture 40% of enterprise spending and 30% of tokens because business requirements for "smart enough" AI are relatively stable while capability-per-dollar improves exponentially, pulling volume toward the tier that satisfies requirements at the lowest cost.

Mechanism

Two curves move at different speeds. AI capability per dollar falls rapidly: a model delivering 77% of frontier performance can cost 2.5% of the frontier price. Enterprise workflow requirements for AI move slowly: a multi-step sales classification task, a document extraction workflow, or a customer-service routing job doesn't need to be better than "good enough." When the requirement is fixed and the cost of satisfying it keeps falling, the tier that satisfies it today becomes the standard choice and holds volume there. Frontier models capture the exploratory and high-stakes layer where requirements are still being defined. Mid-tier captures the production volume layer where requirements are set. This creates a normal distribution shape in revenue, not a pyramid.

Conditions

Holds when: the AI task has a defined, stable requirement that a mid-tier model can satisfy. Production classification, extraction, summarization, and routing tasks fit this pattern. The cost gap between frontier and mid-tier is large enough (currently 10-40x per million tokens) to make tier selection economically significant.

Fails when: the task requires frontier-level reasoning or open-ended generation where no mid-tier model satisfies the requirement. Also fails when task volume is too low for cost differences to matter. Early-stage product development, where requirements are still shifting, will not show this pattern.

Evidence

Tunguz documents spending data from September 2026:

"Demand for intelligence is not a pyramid with a small, wealthy peak paying for everything beneath it. It is a normal distribution with a fat middle."

"Intelligence costs keep plummeting. What enterprises demand from AI does not change nearly as fast."

"Most business AI use is the messy middle: multi-step workflows that need a smart enough model at a price a company can afford."

Specific data:

Signals

Counter-evidence

Gateway and OpenRouter data over-represent developer and API-native usage patterns. Enterprise procurement through cloud providers, which bundles volume discounts and compliance SLAs, may show higher frontier model share. The 40% spend figure for mid-tier is a snapshot; model release cycles compress fast enough that today's mid-tier becomes next quarter's value tier. The distribution shape could shift rapidly if frontier costs drop faster than mid-tier alternatives improve.

Cross-references

Open the interactive view → View original source → Markdown source →