Generative AI Especially Benefits AI Infrastructure OEMs, ODMs, and Cloud Service Providers

Generative AI Especially Benefits AI Infrastructure OEMs, ODMs, and Cloud Service Providers

This IDC Market Perspective discusses generative AI and the opportunities it represents for AI infrastructure OEMs, ODMs, and cloud service providers (SPs). Generative AI has taken the world stage within a matter of months, thanks to several high-profile releases. However, from an AI infrastructure perspective, growth in AI model size and the required compute and storage to train generative AI have been of an evolutionary nature, with predictable capacity requirement increases. That said, generative AI is projected to claim an increasingly larger portion of the worldwide AI compute and storage capacity, therefore representing distinct new market opportunities for server and storage OEMs and ODMs as well as for public cloud service providers and specialty clouds. These opportunities are different for different participants in the marketplace, with cloud SPs becoming the training grounds for any size generative AI models, from small to very large ones, and OEM-served datacenters mostly becoming the realm for fine-tuning and customizing them as well as for training smaller generative AI models from scratch."Generative AI will not require a sudden unanticipated capacity increase in the AI infrastructure market," said Peter Rutten, research vice president, Performance-Intensive Computing at IDC, "but generative AI will claim a growing portion of that capacity and therefore represents distinct new opportunities for AI server and storage OEM and ODMs, as well as cloud service providers."

Please Note: Extended description available upon request.