News Elon Musk plans to scale the xAI supercomputer to a million GPUs — currently at over 100,000 H100 GPUs and counting

[Admin]

xAI to scale the Colossus supercomputer to one million processors, which could create the most powerful machine in the world.

Elon Musk plans to scale the xAI supercomputer to a million GPUs — currently at over 100,000 H100 GPUs and counting : Read more

 

[Mindstab Thrull]

Just for lulz...
Imagine what would happen if he went with Intel for GPUs for this project.
The Foundry would be very busy for quite a while!

 

[Co BIY]

Intel could handle the scale if their hardware was ready.

I'm pretty sure they have made their pitch already.

 

[bit_user]

Just for lulz...
Imagine what would happen if he went with Intel for GPUs for this project.
The Foundry would be very busy for quite a while!

The Intel product he'd almost certainly use would be Gaudi 3, not their GPUs. However, Gaudi 3 isn't even competitive with H100 and at least some of the tiles are still made by TSMC. Not only that, but it also relies on HBM, which is in critically short supply.

So, using Gaudi doesn't avoid the TSMC or HBM production bottlenecks and might not even save that much money at these volumes, in spite of what Intel has claimed.