Nvidia is pitching AI factories, but 81% of companies say their GPUs run at half capacity or less
VentureBeat · Rob Strechay ·
Companies risk spending on more AI infrastructure without knowing whether it will solve their existing problems or deliver a return.
In VentureBeat Intelligence’s September VB Pulse survey, most companies running AI in production reported using half their GPU capacity or less — and most of those companies still plan to adopt new AI infrastructure.
Of the 102 qualified respondents, 68 were running AI in production and provided a GPU utilization figure. Fifty-five of those (81%) reported average utilization of 50% or less, and 71% of that group planned to adopt a new, additional or replacement AI infrastructure platform within 12 months.
Those findings raise a useful question about what buyers expect their next platform to solve. A replacement could improve scheduling, integration, or the economics of an existing workload. A new platform could support work the current environment handles poorly.
Read the full story at VentureBeat · All coverage of this story