Part VI
The Argument Everyone Is Making — And The Number It Skips
Here is where I was heading, and where very nearly every piece written about this lands. You have read it a hundred times by now — on Substack, in YouTube titles, in the replies under any post about AI pricing:
Work out what your monthly usage would cost at the published API rate. It comes to five, ten, twenty times your subscription. Therefore you are being subsidised by the difference. Therefore, when the land-grab ends, your bill rises by that multiple or your usage gets cut to match.
I believed it. I wrote a version of it on this page. Having just watched the overage cliff swallow a session in five minutes, it felt obviously true, because I thought I had seen the "real" price arrive all at once.
Then I went looking for the number that would confirm it, and found something else.
API list price is not a cost. It is a price.
This is the entire error and it is almost embarrassingly simple. The published API rate is a retail price with margin already inside it. Using it to estimate what your usage costs the provider is like working out a hotel's operating costs from the rack rate on the back of the door.
The gap between your $100 subscription and its $2,000 API-equivalent is not a measure of subsidy. Most of it is margin, and the rest is that you are comparing two genuinely different products. API access is metered, guaranteed, free of rate limits, and resellable. A subscription is pooled, throttleable, and can be quietly routed to a cheaper model when the servers are busy. Those things should not cost the same, and the distance between them tells you nothing whatsoever about anyone's cost of delivery.
And the token count is inflated too
There is a second error stacked on top of the first, and it is the one I only noticed from my own habits.
I compact my Claude sessions maybe five times a day across several running chats. Every time, it tells me roughly how much it just cleared — frequently something in the region of half a million tokens. So I have a fairly vivid sense of the sheer volume moving through a working day. That volume is real, and it is exactly where the commentators are getting their raw material: genuine token counts, pulled from genuine usage-tracking tools, and then multiplied by the published API rate.
The problem is what those tokens actually are.
In a long session, the entire conversation gets re-sent with every single turn. That is how these models work — they are stateless, so the context comes back around each time. Count naively and the same half-million tokens get tallied again, and again, and again, once per exchange. Your usage meter is measuring throughput, not fresh work.
Repeated context is cached, and cached tokens are a different economic object entirely. Anthropic bills cache reads at roughly 10% of the normal input rate. The underlying cost is lower still, because the expensive part — the forward pass across that prefix — has already been done and the result is sitting in memory. Re-reading it is nothing like computing it.
So the popular calculation manages to get both halves wrong at once. It takes a token count inflated by re-transmitted context, and prices it at the un-cached retail rate, which is itself a price rather than a cost. The two errors multiply. An honest version of that sum lands somewhere far below the terrifying number, and the terrifying number is the one that gets the thumbnail.
The only question a business actually cares about
Forget what your usage would cost at list price. The question that decides everything is narrower:
Is the company selling inference for more than it costs them to deliver it?
That is gross margin, and it is the number that determines whether a price can hold. Everything else — training bills, data centres, investor patience — is a financing question. Financing questions have completely different consequences, and we will get to them.
That number is not secret, and it is not what the subsidy argument assumes.
| What's measured | Then | Now |
| OpenAI compute margin (revenue left after paying to serve) | ~35% (early 2024) | ~70% (late 2025) |
| Anthropic inference margin | 38% | 70%+ |
| Anthropic compute cost per $1 of revenue | $0.71 (Q1 2026) | $0.56 (Q2 2026) |
| Anthropic internal gross-margin guidance | 50–63% (2026) | 75–77% (2028 target) |
Both frontier labs roughly doubled their serving efficiency in about eighteen months. Inference is not the loss leader. It is the profitable part, and it is getting more profitable.
The most-quoted piece of evidence is eighteen months stale
The single most cited proof of the subsidy thesis is Sam Altman saying OpenAI was losing money on its $200-a-month ChatGPT Pro plan because "people use it much more than we expected."
He said that in January 2025, when OpenAI's compute margin sat somewhere around 35%. It has roughly doubled since. The quote still gets recycled in 2026 as if it described current economics, when what it actually describes is a cost regime that no longer exists. It was true when he said it. It has been quoted well past its expiry date.
So where is the money actually going?
It is going, and the hole is enormous. It is simply not the hole your subscription is filling.
OpenAI has been reported to be burning in the region of $8 billion a year while carrying that 70% compute margin. Those two facts are not in tension. The burn sits in training runs, research salaries, and data-centre commitments, against industry capital expenditure running into the hundreds of billions for 2026 alone.
This distinction matters more than anything else on this page, because the two situations break in completely different ways. If serving lost money on every call, prices would have to rise hard and soon or the service would have to stop, which is the collapse everyone is forecasting. If serving makes money and the losses sit in research, the pressure valve is not your bill at all. It is the R&D budget. What gets cut is the next model, not the one you are already using.
What I think actually happens
Not a price rise. Something quieter, and much harder to complain about:
The squeeze arrives as degradation, not as an invoice. Your bill stays $100. What $100 buys gets smaller: tighter rate limits, a cheaper model quietly serving the same conversation, hard caps where the limits used to be soft. "Unlimited" becomes "generous," which becomes "sufficient."
For a company with healthy serving margins that is a far easier lever to pull than a price rise, and a far harder one for a customer to notice, measure, or protest.
Where the subsidy crowd is right
I would rather steelman this properly than win it cheaply. Everything below cuts against what I just argued:
- Gross margin is not profit. Both major labs are deeply unprofitable at the company level. A 70% margin on serving and a multi-billion-dollar annual loss are entirely compatible, and both are true right now.
- None of these numbers are audited. No lab publishes inference COGS. Everything above is reporting and estimation from partial figures, and estimates of Anthropic's 2026 gross margin range from roughly 44% to over 70% depending on what is being counted.
- The improvement may be flattered. Ed Zitron has argued the recent margin figures lean on time-limited compute discounts and non-GAAP presentation rather than durable efficiency. Worth being precise, though: he is not disputing that inference is margin-positive. He is disputing company-level profitability. That is a different claim, and it is not the one I am making.
- The top tier may genuinely lose money. A blended margin can conceal a loss-making power-user tier. If you are the person running agents overnight, you may well be served at a personal loss inside a subscriber base that is profitable overall.
- Compute is getting more expensive. Rental rates for high-end chips have risen sharply as demand outpaces supply, which cuts directly against further margin expansion.
- None of this defends the valuations. You can be entirely right that inference is profitable and entirely right that the equity prices are deranged. Separate questions, separate evidence.
Why the loud version is the one you keep hearing
Two selection effects, and they compound. The person calculating their $2,000-a-month API equivalent is, by definition, among the heaviest users on the platform. Subscriptions run on gym-membership economics: a pool dominated by light users, quietly paying for the few who turn up every day. The person writing the post is the guy at the gym six mornings a week, generalising from his own quads to the entire membership.
And "you are being subsidised, the bill is coming" is simply a better headline than "serving margins appear healthy and improving." One of those gets watched. The other one is this article.
Sources for this section: 80,000 Hours analysis of AI lab economics (Aug 2026); reporting on OpenAI and Anthropic compute margins via SaaStr and Yahoo Finance; Ed Zitron, "Anthropic's Profitability Swindle"; Anthropic's published prompt-caching rates (cache reads at ~10% of base input); Altman's January 2025 remarks on ChatGPT Pro; Bloomberg, CNBC and Fortune on the Kimi K3 release. Margin figures are reported rather than audited — no lab publishes inference cost of goods sold, and I have flagged the disagreements above rather than quietly picking the most convenient number.
This Isn't Just a Western Story
One thing the pricing outside the US clarifies: a promotion ending is a real event, and it is a different event from costs catching up. Watch which is which below.
The release pace is the other half of it. Moonshot shipped Kimi K3 in July 2026 — 2.8 trillion parameters, a million-token context window, open weights, benchmarked against the frontier rather than politely beneath it. Chinese labs are now landing frontier-class models faster than the subsidy argument's timeline assumes, with different cost structures and different reasons to price the way they do. That matters, because the whole thesis quietly depends on pricing power arriving once the land-grab finishes. Pricing power requires somewhere for customers not to go.
The same week I was writing this, Moonshot AI in China released Kimi K3 — a new 2.8-trillion-parameter model with a 1-million-token context window. My first assumption was "cheap Chinese alternative, undercutting Western frontier pricing." That assumption turned out to be wrong, and the way it's wrong is the actual point.
| Model |
Price per 1M tokens (in / out) |
What that tells you |
| Kimi K3 (Jul 2026) |
$3 / $15 |
Priced at direct parity with Claude Sonnet — not a discount play, a capability-parity claim |
| Kimi K2.6 / K2.7 |
$0.95 / $4.00 |
The actual "cheap Chinese model" tier — this is what genuinely undercuts Western pricing |
| DeepSeek V4 Pro |
$0.435 / $0.87 |
Had a 75% introductory discount that expired May 31, 2026 — the rate then jumped straight to roughly 4x |
| DeepSeek V4 Flash |
$0.14 / $0.28 |
The genuine bargain-bin tier, small-model-scale pricing |
Two things jump out:
- DeepSeek already lived through exactly the cliff this whole piece is about — a steep introductory discount, followed by a sudden, un-cushioned jump to real pricing the moment the promotional window closed. That's not a hypothetical prediction anymore; it already happened, on the other side of the planet, months before I hit my own wall.
- The flagship release — the one actually competing on raw capability — didn't undercut the West at all. It matched it. The subsidy war in Chinese AI looks concentrated in the older, smaller-model tier (aimed at winning developer habit and ecosystem lock-in), not the frontier tier (aimed at proving China can match the best, full stop).
There's also a practical wrinkle in treating "open-weight" as an escape hatch from any of this: Kimi K3's 2.8 trillion parameters make it a non-starter for genuinely local, on-your-own-hardware use — nobody is running this on a home rig. "Open weight" mostly benefits well-capitalized resellers who can rent the GPUs and undercut on hosting, not individuals looking to sidestep the subsidy cycle entirely.
The wall doesn't move. It just relocates — to a different company's balance sheet, on a different continent.
Sources: MarkTechPost on Kimi K3's specs and pricing; VentureBeat on the K3 launch; Kimi API pricing (K2.6/K2.5); DeepSeek/Kimi/Qwen/GLM pricing comparison.