Nvidia is pitching AI factories, but 81% of companies say their GPUs run at half capacity or less

VentureBeat · Rob Strechay ·

Companies risk spending on more AI infrastructure without knowing whether it will solve their existing problems or deliver a return.

In VentureBeat Intelligence’s September VB Pulse survey, most companies running AI in production reported using half their GPU capacity or less — and most of those companies still plan to adopt new AI infrastructure.

Of the 102 qualified respondents, 68 were running AI in production and provided a GPU utilization figure. Fifty-five of those (81%) reported average utilization of 50% or less, and 71% of that group planned to adopt a new, additional or replacement AI infrastructure platform within 12 months.

Those findings raise a useful question about what buyers expect their next platform to solve. A replacement could improve scheduling, integration, or the economics of an existing workload. A new platform could support work the current environment handles poorly.

Read the full story at VentureBeat · All coverage of this story