News AMD Unveils Nvidia DGX A100 Specs in Formal Announcement

[Admin]

Didn't see that one coming, did you?

AMD Unveils Nvidia DGX A100 Specs in Formal Announcement : Read more

 

[spentshells]

Starts at 199,999.... oooof

 

[bit_user]

Starts at 199,999.... oooof

Makes the Titan V look like a bargain!

 

[hobobot]

I found the data sheet and it's a max power draw of 6.5 kW.......... which isn't terrible efficiency for flops/watt but god damn.... the cooling needed....

 

[bit_user]

I found the data sheet and it's a max power draw of 6.5 kW.......... which isn't terrible efficiency for flops/watt but god damn.... the cooling needed....

That's a little above where I estimated. I think I was saying somewhere around 5 kW.

Did they say how tall it is? Looks like it could be 6U, which would be a little less than 1.1 kW per U. That's not unreasonable, and plenty big enough for some large fans. Though, when it really gets cranking, I'm sure it will sound like a hovercraft.

 

[bit_user]

Heh, I just had this image of a server with an automotive radiator bolted on. Someone should definitely do that, if it hasn't been done already.

Edit: of course it's been done.

can i use a car radiator in my water loop?

I did research quite a bit before asking this, but could not find a concrete answer. sorry If this has been asked multiple times, but please do not send hate comments. I am wondering if a car rad would do the job just as good a normal pc rad. Fitting the tubes is not a problem, as the car rad i...

forums.tomshardware.com

 

[spongiemaster]

Starts at 199,999.... oooof

Jensen Huang catch phrases aside, $200,000 is a bargain compared to what it would cost to build a comparable system with previous generation hardware.

 

[DotNetMaster777]

Are there any low price analogs of Nvidia DGX ??

The price is really crazy !!!!!

 

[bit_user]

$200,000 is a bargain compared to what it would cost to build a comparable system with previous generation hardware.

Almost anything is a bargain, by that definition.

It will be telling to see how it stacks up & prices against a comparable system from Intel/Habana Labs.

 

[bit_user]

Are there any low price analogs of Nvidia DGX ??

Depends on why you need multi-GPU. What makes DGX special is the high-speed GPU-to-GPU interconnects. This can be useful for training and inferencing extremely large networks. However, if your network is smaller or you just need to accelerate inferencing, then you might be able to go with T4's.

Another option might be to rent time on Google's TPU, if you don't need to actually own the hardware.