How does open source model growth affect AI infrastructure demand and compute margins?
Answered at 0:44 in Why the Markets Are Pricing AI Wrong | Gavin Baker · Invest Like The Best
How does open source model growth affect AI infrastructure demand and compute margins?
Open source models like GLM 5.2 and Kimi shifted the token mix from expensive frontier model tokens with 80-95% inference margins toward open source alternatives. While this reduces margin dollars for frontier model providers like Anthropic and OpenAI, it does not reduce overall compute demand because all tokens require identical amounts of computing resources. Open source effectively transfers margin dollars from frontier model providers directly to the AI infrastructure layer where cloud providers charge the same amount for compute, so total demand for infrastructure remains unchanged or increases due to the margin elasticity effect.
Full answer and detailsRead the whole answer, key facts and every other question from this episode
In short
Open source models like GLM 5.2 and Kimi shifted the token mix from expensive frontier model tokens with 80-95% inference margins toward open source alternatives.
Gavin Baker, Investor at Invest Like The Best · Why the Markets Are Pricing AI Wrong | Gavin Baker · Invest Like The Best · answer at 0:44
Key takeaways
- Open source models like GLM 5.2 and Kimi shifted the token mix from expensive frontier model tokens with 80-95% inference margins toward open source alternatives.
Quote to remember
“I haven't been able to find one that is like a quantitative metric. The underlying fundamentals are improving and NVIDIA is actually at its lowest forward PE of the last 10 years.”
— Gavin Baker
The full answer · about 1 min
Open source models like GLM 5.2 and Kimi shifted the token mix from expensive frontier model tokens with 80-95% inference margins toward open source alternatives. While this reduces margin dollars for frontier model providers like Anthropic and OpenAI, it does not reduce overall compute demand because all tokens require identical amounts of computing resources. Open source effectively transfers margin dollars from frontier model providers directly to the AI infrastructure layer where cloud providers charge the same amount for compute, so total demand for infrastructure remains unchanged or increases due to the margin elasticity effect.
Key facts
- NVIDIA at lowest forward PE of last 10 years as of recording
- GPU rental prices rising 50-60% in 6-7 months (mid-$2 to near $4 per GPU hour for Blackwell)
- Hyperscaler operating cash flow acceleration from 28% to 32% (35% adjusted for one-time items)
- 2 trillion dollars in potential hyperscaler operating cash flow if Blackwell/Rubin monetize above Ampere rates
- 700 billion dollars of credit demand potentially removed by improved operating cash flow
People, companies and topics mentioned
More answers from this episode
- 0:19Why is NVIDIA trading at its lowest forward PE in the last 10 years despite accelerating AI demand metrics?
- 0:28What is the primary factor that would reverse the current bullish AI infrastructure outlook according to Gavin Baker?
- 0:38What is driving GPU rental price increases despite expectations they would decline in 2024-2025?
- 0:41Why did the market interpret Meta's plan to rent compute capacity as negative despite no CapEx cuts?
- 0:44How are hyperscaler operating cash flows accelerating despite market concerns about AI infrastructure financing?