News From Opteron to Milan: Crusher Supercomputer Comes Online With AMD CPUs and GPUs

[Admin]

The Oak Ridge Leadership Computing Facility (OLCF) announced today that Crusher, a small iteration of the Frontier supercomputer that will be the United States' first exascale machine, is now online and generating impressive results.

From Opteron to Milan: Crusher Supercomputer Comes Online With AMD CPUs and GPUs : Read more

 

[Soaptrail]

I know this is overly simplistic but they are replacing 18,688 Opteron CPU's with 320 EPYC CPU's, that is a huge reduction!

 

[jeremyj_83]

I know this is overly simplistic but they are replacing 18,688 Opteron CPU's with 320 EPYC CPU's, that is a huge reduction!

I think it is only 192 Epycs since each node is only a single 64 core chip. There are 768 GPUs though.

 

[Kamen Rider Blade]

So, does that mean there's more physical room / cooling capacity at the Titan Data Center for expansion of the Super Computer?

 

[jp7189]

You know the old saying "One exaflop in the hand is worth two in the Aurora."

 

[jeremyj_83]

So, does that mean there's more physical room / cooling capacity at the Titan Data Center for expansion of the Super Computer?

The old Titan took up 4,352 ft2 in 200 cabinets and used 8.2 MW of power for a total of 17.6 petaFLOPS of sustained performance (27 petaFLOPS theoretical). The new Crusher needs only 44 ft2 in 1.5 cabinets but power draw isn't given and neither is sustained performance. However, each of the 768 GPUs can theoretically do 53 teraFLOPS so we have a theortical of 40.7 petaFLOPS. That gives Crusher 1.5x more theoretical performance in 1% of the total space required for Titan.

We can assume that Crusher will use less far power as well. Each GPU is 550W and each CPU is 280W (assumed since Zen 3 are usually 280W for 64 core models). If all GPUs and CPUs are running at max draw that puts consumption at 476KW. Even if that number is doubled for RAM, NIC, and storage power that will put power draw around 1MW. In theory we have a system with 1.5x more performance using 1/8 the power and need 1% the total floor space in 10 years.

 

[Kamen Rider Blade]

The old Titan took up 4,352 ft2 in 200 cabinets and used 8.2 MW of power for a total of 17.6 petaFLOPS of sustained performance (27 petaFLOPS theoretical). The new Crusher needs only 44 ft2 in 1.5 cabinets but power draw isn't given and neither is sustained performance. However, each of the 768 GPUs can theoretically do 53 teraFLOPS so we have a theortical of 40.7 petaFLOPS. That gives Crusher 1.5x more theoretical performance in 1% of the total space required for Titan.

We can assume that Crusher will use less far power as well. Each GPU is 550W and each CPU is 280W (assumed since Zen 3 are usually 280W for 64 core models). If all GPUs and CPUs are running at max draw that puts consumption at 476KW. Even if that number is doubled for RAM, NIC, and storage power that will put power draw around 1MW. In theory we have a system with 1.5x more performance using 1/8 the power and need 1% the total floor space in 10 years.

So I'll take that as a YES! =D