Elon Musk says xAI is targeting 50 million 'H100 equivalent' AI GPUs in five years — 230k GPUs, including 30k GB200s already reportedly operational for training Grok
by ashilov@gmail.com (Anton Shilov) from Latest from Tom's Hardware on (#6YV9Z)
Elon Musk's xAI aims to achieve 50 exaFLOPS of AI training compute - equivalent to 50 million H100 GPUs - within five years. Thanks to Nvidia's rapid performance scaling, it is more than doable even with less than a million GPUs, but that will likely require an immense amount of power.