New research finds 83% of enterprises run GPUs at under 50% utilization, and fewer than half can accurately track their AI compute spend.
A new enterprise AI infrastructure report finds a widening gap between AI spend velocity and financial oversight. 83% of surveyed organizations operate their GPU fleets at 50% utilization or below, and fewer than half can rigorously track what those clusters actually cost per workload.
At current H100 and B200 pricing, a fleet running at 40% utilization is effectively burning six-figure monthly line items on idle silicon. Multiply that across the Fortune 500 and the aggregate waste dwarfs most enterprise SaaS categories.
Cost visibility is hard because production AI workloads span reserved capacity, spot markets, provider credits, and increasingly, colocated on-prem gear. Existing FinOps tools weren't built for that mix, and the vendor-side "unit economics" dashboards remain shallow.
A wave of AI-specific FinOps startups (Robusta, MosaicML's new spinoff, and Anthropic's own admin console updates) are trying to close the gap. Adoption is early but growing fast — for the same reason cloud FinOps eventually became table stakes.
Source: VentureBeat