Claim
Eighty-four percent of tokens on OpenRouter run on non-state-of-the-art models. The six models that generate the supermajority of that volume deliver 77% of frontier performance at 2.5% of Claude Fable 5's price. Most enterprise buyers have already settled on this price-over-performance tradeoff and are not waiting for the next frontier release.
Mechanism
Frontier model releases improve benchmark scores every few months, but application teams are optimizing against a different objective. For production workloads, the relevant tradeoff is cost per task at acceptable quality, not maximum benchmark performance. A model delivering 77% of frontier capability at 2.5% of frontier cost resolves a different Pareto problem: how to handle a large volume of inference-bound tasks within budget. Frontier models capture the research and high-stakes judgment layer; commodity-grade models capture the production volume layer. These are separate markets. Labs racing to release SOTA every six weeks are generating diminishing incremental demand from the production application segment.
"84% of tokens on OpenRouter are not state of the art."
"Application deployment is the other story...They are optimizing against a different Pareto frontier, price over performance."
Tunguz also notes that adoption of the newest frontier model is slow even within a single provider: Fable 5 captured only 6% of Anthropic token volume and 11% of spend one month after launch.
Conditions
Holds when: the workload is production inference at scale and task quality at the 77-percentile-of-frontier level is acceptable. Applies most directly to bulk classification, summarization, extraction, and generation tasks where human review does not catch every output.
Fails when: the task genuinely requires frontier-level reasoning, novel problem solving, or high-stakes outputs where quality differences between tiers translate directly into business risk.
Evidence
OpenRouter token distribution data from the week of August 10, 2026:
- 84% of total token volume runs on non-SOTA models
- Six models account for approximately 80% of that volume
- Blended price for those six models: $0.50 per million tokens
- Claude Fable 5: $20 per million tokens (40x more expensive)
- Those six models deliver approximately 77% of frontier benchmark performance
- Fable 5 captured 6% of Anthropic token share and 11% of spend in its first month post-launch
- Best open-weight models scored 80% of frontier benchmarks by May 2026, up from 48% a year prior
Signals
- Monthly AI inference cost holds steady or falls even as token volume grows, indicating production routing to cheaper tiers.
- Engineering discussions center on task-routing and model selection by cost tier rather than migration to the latest release.
- Internal benchmarks show sub-1% quality regression when switching from frontier to mid-market model on most production task types.
Counter-evidence
OpenRouter reflects developer and API-native usage; enterprise contracts procured through cloud providers and direct relationships may show different distribution. Frontier model share may undercount use cases where privacy, compliance, or SLA requirements mandate a specific model. The 77% performance figure compresses across benchmark types; tasks that skew toward frontier-only capabilities (novel reasoning, long-horizon agents) will show larger quality gaps.
Cross-references
- AI labs sustain consumption growth under supply constraints by segmenting models into tiers so workloads route to cheaper alternatives rather than stopping: the supply-side version of this finding; labs create tier segmentation precisely to capture the demand Tunguz is observing here.
- Model substitution savings are reinvested in more tokens, not returned to the budget: buyers who switch to cheaper models reinvest savings in more tokens rather than returning budget.