How has AI inference spending changed for engineering teams at a16z crypto in the past three months?
Answered at 4:00 in How AI is Changing the Way We Build Companies (ft. Guy Wuollet and Noah Citron) · a16z crypto show
How has AI inference spending changed for engineering teams at a16z crypto in the past three months?
In the past three months, a16z crypto's engineering team noticed that their ability to get more work done has become linear with the amount of money allocated to token budgets. Token spend has grown from a few thousand dollars monthly to a few hundred thousand dollars monthly, fundamentally changing how the team thinks about resource allocation from a capacity constraint to a budget allocation problem.
Full answer and detailsRead the whole answer, key facts and every other question from this episode
In short
In the past three months, a16z crypto's engineering team noticed that their ability to get more work done has become linear with the amount of money allocated to token budgets.
Noah Citron, Head of Engineering at a16z crypto · How AI is Changing the Way We Build Companies (ft. Guy Wuollet and Noah Citron) · a16z crypto show · answer at 4:00
Key takeaways
- In the past three months, a16z crypto's engineering team noticed that their ability to get more work done has become linear with the amount of money allocated to token budgets.
Quote to remember
“Now the question no longer becomes how much work can we do, but rather how much money can we allocate to the token budget in order to get work done.”
— Noah Citron
The full answer · about 3 min
In the past three months, a16z crypto's engineering team noticed that their ability to get more work done has become linear with the amount of money allocated to token budgets. Token spend has grown from a few thousand dollars monthly to a few hundred thousand dollars monthly, fundamentally changing how the team thinks about resource allocation from a capacity constraint to a budget allocation problem.
Key facts
- Token spend increased from a few thousand dollars per month to a few hundred thousand dollars per month at a16z crypto engineering team over three months
- Token spend could theoretically reach a few million dollars per month with increased allocation
- CAC to LTV (Customer Acquisition Cost to Lifetime Value) is the classic metric used by Web2 businesses to measure unit economics and capital efficiency
People, companies and topics mentioned
More answers from this episode
- 3:00What financing model could better suit software businesses that need variable token spending rather than permanent headcount?
- 8:00What is the difference between treating token spend as headcount versus treating it as variable operational cost?
- 10:00How can engineering teams use AI to autonomously run A-B tests and measure their impact on product metrics?
- 17:00What makes the pod shop model difficult to apply to typical software engineering organizations?