Listenly

How does open source model growth affect AI infrastructure demand and compute margins?

Answered at 0:44 in Why the Markets Are Pricing AI Wrong | Gavin Baker · Invest Like The Best

— questions searchable right now

How does open source model growth affect AI infrastructure demand and compute margins?

Open source models like GLM 5.2 and Kimi shifted the token mix from expensive frontier model tokens with 80-95% inference margins toward open source alternatives. While this reduces margin dollars for frontier model providers like Anthropic and OpenAI, it does not reduce overall compute demand because all tokens require identical amounts of computing resources. Open source effectively transfers margin dollars from frontier model providers directly to the AI infrastructure layer where cloud providers charge the same amount for compute, so total demand for infrastructure remains unchanged or increases due to the margin elasticity effect.

Gavin Baker on Invest Like The BestAll answers from this podcast →
Full answer and detailsRead the whole answer, key facts and every other question from this episode

In short

Open source models like GLM 5.2 and Kimi shifted the token mix from expensive frontier model tokens with 80-95% inference margins toward open source alternatives.

Gavin Baker, Investor at Invest Like The Best · Why the Markets Are Pricing AI Wrong | Gavin Baker · Invest Like The Best · answer at 0:44

Key takeaways

  • Open source models like GLM 5.2 and Kimi shifted the token mix from expensive frontier model tokens with 80-95% inference margins toward open source alternatives.

Quote to remember

“I haven't been able to find one that is like a quantitative metric. The underlying fundamentals are improving and NVIDIA is actually at its lowest forward PE of the last 10 years.”

— Gavin Baker

The full answer · about 1 min

Open source models like GLM 5.2 and Kimi shifted the token mix from expensive frontier model tokens with 80-95% inference margins toward open source alternatives. While this reduces margin dollars for frontier model providers like Anthropic and OpenAI, it does not reduce overall compute demand because all tokens require identical amounts of computing resources. Open source effectively transfers margin dollars from frontier model providers directly to the AI infrastructure layer where cloud providers charge the same amount for compute, so total demand for infrastructure remains unchanged or increases due to the margin elasticity effect.

Key facts

  • NVIDIA at lowest forward PE of last 10 years as of recording
  • GPU rental prices rising 50-60% in 6-7 months (mid-$2 to near $4 per GPU hour for Blackwell)
  • Hyperscaler operating cash flow acceleration from 28% to 32% (35% adjusted for one-time items)
  • 2 trillion dollars in potential hyperscaler operating cash flow if Blackwell/Rubin monetize above Ampere rates
  • 700 billion dollars of credit demand potentially removed by improved operating cash flow

People, companies and topics mentioned

NVIDIAAnthropicOpenAIMetaMicrosoftAmazonBlackwellRubin

More answers from this episode

 ·  All answers from Invest Like The Best →
—
—
0:00
0:00