News Nvidia Submits First Grace Hopper CPU Superchip and MLPerf AI Benchmarks

[Admin]

Nvidia submits the first AI inference benchmarks for both its Grace Hopper CPU Superchip and its L4 GPUs.

Nvidia Submits First Grace Hopper CPU Superchip and MLPerf AI Benchmarks : Read more

 

[NeoMorpheus]

Superchip​

They are really full of themselves even on the naming dept...

 

[artk2219]

They are really full of themselves even on the naming dept...

To be fair you do want to market your stuff to get sales. The other part of that is, I mean, of course they're full of themselves, it's Nvidia hah.

 

[bit_user]

"Superchip"​

They are really full of themselves even on the naming dept...

It helps to understand what they mean by it. Although they don't shy away from making it sound like a superlative, they call it a "superchip" because it's actually a pair of chips. So, being more than a single chip - and yet it still behaves as a logical unit, in some respects - it's not technically incorrect to call it a "superchip".

They support 3 different pairings:

• Grace + Grace
• Hopper + Hopper
• Grace + Hopper

The entire pair fits on a single SXM daughter card.

 

[NeoMorpheus]

It helps to understand what they mean by it. Although they don't shy away from making it sound like a superlative, they call it a "superchip" because it's actually a pair of chips. So, being more than a single chip - and yet it still behaves as a logical unit, in some respects - it's not technically incorrect to call it a "superchip".

They support 3 different pairings:

• Grace + Grace
• Hopper + Hopper
• Grace + Hopper

The entire pair fits on a single SXM daughter card.

Soooo, just like all AMD APU's, SOC's and their MI300 chips?

Actually, AMD should then call the MI300X The UltraChip! (including the exclamation mark ) given the monster that it claims to be.

 

[bit_user]

Soooo, just like all AMD APU's, SOC's and their MI300 chips?

That's a different, because you can't have one of those chiplets in isolation. In Nvidia's case, we already have H100 GPUs on their own card and you could obviously do the same thing with a Grace CPU. So, it's not the same kind of arrangement.

What AMD's chiplet-based CPUs are classically called is a MCM (Multi-Chip Module).

Actually, AMD should then call the MI300X The UltraChip! (including the exclamation mark ) given the monster that it claims to be.

Eh, I guess they can call it whatever they want.

 

[TJ Hooker]

Yeah, the "superchip" sounds like something closer to a dual socket motherboard concept. I.e. two separate processor packages on a single board, both capable of independent operation, rather than multiple chiplets/tiles in a single package. Except it's different than a dual socket motherboard, in that both processors can either a CPU or GPU, among other things.

 

[bit_user]

Yeah, the "superchip" sounds like something closer to a dual socket motherboard concept. I.e. two separate processor packages on a single board, both capable of independent operation, rather than multiple chiplets/tiles in a single package.

There's an important distinction, here. It's not like just having a dual-socket motherboard, because these Superchips typically exist as nodes in the context of a larger, cache-coherent system with a unified memory space. You can have like 8 or maybe more of these nodes sharing the same memory space, connected via NVLink.

It's worth pointing out that the main advantage Nvidia gets from these Grace + Hopper superchips is that the Grace nodes let them intersperse 512 GB of memory throughout the NVLink topology. This gives them scalable, distributed memory to help support the Hopper GPUs.

Say what you want about their business practices, but Nvidia knows what it's doing, engineering-wise. No matter what their business practices, they couldn't maintain their lead, in this hyper-competitive industry, without the top engineering talent to back it up.

 

[NeoMorpheus]

That's a different, because you can't have one of those chiplets in isolation. In Nvidia's case, we already have H100 GPUs on their own card and you could obviously do the same thing with a Grace CPU. So, it's not the same kind of arrangement.

What AMD's chiplet-based CPUs are classically called is a MCM (Multi-Chip Module).

Wouldn that apply with Ryzen Z1/Extreme and SOCs in the last couple of consoles?

Because last I checked, they are all one chip, not MCM, but I could be wrong.

Eh, I guess they can call it whatever they want.

Given how things are going, we should trive for more silly names :-D