a builder's codex
codex · operators · Tomasz Tunguz · ins_tunguz-ai-infrastructure-bullwhip

AI infrastructure shortages cascade through hardware layers in multi-year waves, not all at once

By Tomasz Tunguz · General Partner, Theory Ventures · 2026-08-23 · essay · The AI Bullwhip

Tier B · TL;DR
AI infrastructure shortages cascade through hardware layers in multi-year waves, not all at once

Claim

Each AI infrastructure bottleneck resolves in one hardware layer only to surface in the next, following the classic bullwhip pattern: GPU constraints in 2023, memory and flash in 2024-25, CPUs in late 2025, storage in 2026, and data center power capacity through 2031.

Mechanism

A demand shock at the application layer propagates upstream through hardware supply chains. Each layer has a manufacturing lead time of 12-24 months, so shortages and overreactions arrive one layer at a time. Suppliers face an impossible choice: underbuild and lose market share, or overbuild and absorb fixed costs when demand normalizes. The mismatch between order books and actual demand amplifies at each layer, producing a sequential rather than simultaneous constraint cascade.

Conditions

Holds when: AI infrastructure demand grows faster than any single hardware layer can respond within 12 months, forcing sequential constraint.

Fails when: Demand stabilizes or contracts sharply before the cascade completes. Over $2 billion in data center expansions arriving 2027-2028 may flip the 2026 shortage into a 2028 glut if revenue growth slows.

Evidence

Tunguz traces a specific cascade with data at each layer: H100 GPU rental rates exceeded $9/hour in 2023; SSD prices rose 80% quarterly in mid-2024 as manufacturers shifted production toward High Bandwidth Memory; Intel Xeon ASPs rose 27% year-over-year in late 2025 as agentic workloads shifted CPU-to-GPU ratios to 1:1; Western Digital and Seagate 2026 storage production sold out; data centers now cost $20 billion per gigawatt with turbine lead times of three years and order books extending through 2031.

"If you don't build enough, you lose market share. If you build too much, you get dinged for fixed costs."

Signals

Counter-evidence

Bullwhip overcorrection is the equal risk. If AI software revenue does not justify $20B/GW facility costs by 2028, the same cascade dynamic produces surplus rather than shortage. Historical semiconductor cycles suggest the overshoot often exceeds the original shortage. Tunguz names this risk explicitly: "over $2 billion in infrastructure expansions arriving 2027-2028 may face overcapacity."

Cross-references

Open the interactive view → View original source → Markdown source →