#303 The True Cost of AI: What CFOs Need to Know Ed Barrow Founder & CEO, Cloud Capital
For fifteen years the software P&L was a settled question: hosting was a rounding error, gross margins held above 80%, and investors underwrote growth against a predictable annuity stream. That assumption is breaking. AI and cloud infrastructure has become one of the largest and least predictable costs on the P&L, moving faster than most finance teams have built the vocabulary or forecasting discipline to handle it. Ed Barrow, Founder and CEO of Cloud Capital, joins Kevin Appleby to unpack research with 100 growth-stage CFOs: 96% blew through their AI budget last year, with overruns driven more by compute and storage than by model costs, and the average software company now spends 15–20% of revenue on compute and AI, a fourfold jump, while over half of AI-native companies exceed 30%.
Barrow draws a distinction many finance teams miss: workforce AI scales with headcount and belongs in OPEX, while product AI scales with customer usage and belongs in COGS. Getting that split wrong distorts unit economics badly — he has seen entire cloud bills dumped into gross margin, and entire model bills buried in R&D.
He also warns against betting on falling token prices: consumption has outrun per-unit declines, and providers will pivot to profitability much as Uber did. With roughly $800 billion of debt-financed data centre buildout this year, the market will shift from pay-as-you-go to committed multi-year contracts. His prescription: befriend engineering, learn the language of tokens and model selection, and act as a chief investment officer who sets guardrails before the bill arrives.
Key topics covered:
- 96% of CFOs exceeded their AI budget last year, and the overruns were driven more by compute and data storage than by model and token costs, a blind spot for teams focused solely on token spend
- AI spend has reached 15–20% of revenue for the average software company, up fourfold in months, with over half of AI-native companies above 30%, a fundamentally different business model from the 80%-margin SaaS playbook investors built their assumptions on
- Workforce AI belongs in OPEX and product AI belongs in COGS, and misallocating between them distorts gross margin in either direction, particularly when tokens arrive through three or four billing routes at once, including hosted models inside AWS, Google Cloud and Azure invoices
- Seat-based pricing breaks when costs scale with customer usage, creating the “token treadmill”, loyal, highly engaged customers accumulate data and context and become the least profitable cohort over time unless pricing is aligned to value and outcomes
- Betting on falling token prices is a dangerous gamble, consumption growth has outrun per-unit price declines, and heavily funded model providers heading toward IPO will move from subsidised customer acquisition to profitable pricing, following the Uber trajectory
- Debt-financed data centre buildouts will push the market from pay-as-you-go to committed contracts, handing CFOs material long-term liabilities to underwrite, with commitments often carrying 30–40% discounts but real balance sheet risk if utilisation falls short
Links
Timestamps:
- 00:32 — From rounding error to runaway bill: how the cloud line item changed
- 03:32 — Workforce AI vs. product AI: the OPEX/COGS split that changes everything
- 13:15 — 96% of CFOs blew their AI budget — and compute, not tokens, was the culprit
- 18:18 — The token treadmill: why your most loyal customers become your least profitable
- 20:55 — The end of the 80% gross margin playbook, and the Uber analogy for token pricing
- 26:41 — $800bn of debt-financed data centres and the coming shift to committed contracts
- 30:53 — What to do tomorrow: befriend engineering and think like a chief investment officer
- 36:11 — Paying for tokens through four different channels, and the allocation trap
Find out more about GrowCFO
If you enjoyed this podcast, you can subscribe to the GrowCFO Show with your favorite podcast app. The GrowCFO show is listed in the Apple podcast directory, Spotify and many others. Why not subscribe there today? That way, you never miss an episode.
GrowCFO is a great place to extend your professional network. Join GrowCFO as a free member today and participate in our regular networking events and webinars. Premium members can also access our extensive training center and CFO Digital Toolkit. You can enroll in our flagship Future CFO or Finance Leader programs here.
You can find out more and join today at growcfo.net
Podcast: Play in new window | Download
