a builder's codex
codex · operators · Tomasz Tunguz · ins_tunguz-inference-pricing-value-beats-cost-plus

Reselling inference at cost-plus yields zero margin as model prices compress

By Tomasz Tunguz · General Partner, Theory Ventures · 2026-06-22 · essay · So You Want to Sell Inference

Tier B · TL;DR
Reselling inference at cost-plus yields zero margin as model prices compress

Claim

Reselling AI inference at a cost-plus markup is a zero-margin business; the only sustainable pricing model is outcome-based, tied to value delivered rather than tokens consumed.

Mechanism

As model providers compete, inference costs compress toward commodity. A cost-plus markup shrinks in lock-step with the underlying cost, eventually reaching zero. Customers who bring their own API keys (BYOK) eliminate the markup entirely. Value-based pricing (per resolved ticket, per completed task, per generated report) decouples revenue from infrastructure cost. When inference gets cheaper, the value-based operator's margin expands rather than disappears.

Conditions

Holds when: the product delivers a measurable outcome the customer values above the inference cost (support resolution, code completion, document generation). Outcome value must be definable and consistently produced.

Fails when: the customer cannot define or measure outcome value, or when the product is primarily an interface layer rather than an outcome-generating system. Also fails when the customer's procurement process requires itemized cost-plus billing.

Evidence

Tunguz draws the distinction directly:

"Reselling inference at cost is a zero-margin business: a payment rail, not a software company."

"Cost-plus is a payment processor with a dashboard. Value-based is software."

He notes that BYOK arrangements destroy cost-plus viability entirely while leaving value-based pricing intact, forcing cost-plus operators to compete on platform value they have not yet built.

Signals

Counter-evidence

Value-based pricing requires clear outcome measurement, which is difficult in creative or advisory use cases where value is subjective. Buyers in budget-constrained organizations may prefer cost-plus billing because it maps to procurement categories they already understand. Some categories (e.g., copilots that augment rather than replace human steps) resist clean outcome metrics, leaving cost-plus as the only practical option until measurement matures.

Cross-references

Open the interactive view → View original source → Markdown source →