News Nvidia Sold 900 Tons of H100 GPUs Last Quarter: Analyst

[Admin]

Nvidia shipped over 900 tons of H100 compute GPUs in Q2 2023, says Omdia.

Nvidia Sold 900 Tons of H100 GPUs Last Quarter: Analyst : Read more

 

[BX4096]

To add some more context to the story, here are some other things that weigh 900 tons:

• 4.5 Boeings 747s
• 11 Space Shuttle Orbiters
• 215,827 gallons of water
• 299 Ford F150-Lightnings
• 181,818 PlayStation 5s
• 32,727 Golden Retrievers

Or a third Elon Musk's net worth converted into $100 dollar bills and weighed. Also, you have a rounding error in your Golden Retriever count. It's 32,727 Retrievers and 3 Chihuahuas, to be precise.

 

[zecoeco]

All to run a stupid chatbot, and evilish projects to replace me and you the author, then he's or she's company or business offload more employees, increasing their profits, and leading to a crowd of jobless people.

The hype is real ¯\_(ツ)_/¯

 

[aberkae]

All to run a stupid chatbot, and evilish projects to replace me and you the author, then he's or she's company or business offload more employees, increasing their profits, and leading to a crowd of jobless people.

The hype is real ¯\_(ツ)_/¯

All to yield a 25% anonomoly rate. They will milk the plautau to get to the 99.99999% accuracy.

 

[thisisaname]

To add some more context to the story, here are some other things that weigh 900 tons:

• 4.5 Boeings 747s
• 11 Space Shuttle Orbiters
• 215,827 gallons of water
• 299 Ford F150-Lightnings
• 181,818 PlayStation 5s
• 32,727 Golden Retrievers

900 US tonnes is 816466KG or 1360776 hibernation weight hedgehogs which is around about 1.55 times the UK population.

 

[pjmelect]

• 4.5 Boeings 747s
• 11 Space Shuttle Orbiters
• 215,827 gallons of water
• 299 Ford F150-Lightnings
• 181,818 PlayStation 5s
• 32,727 Golden Retrievers

Americans will use anything other than the metric system.

 

[bit_user]

Kind of silly way to measure them, since we all know the mass of these products is dominated by the cooling system. It sure is a lot of copper, though.

 

[emike09]

That's around 180,000 cats!!!!

 

[NeoMorpheus]

What its the point of this article, besides the usual ngreedia hyping?

 

[Geef]

That's around 180,000 cats!!!!

No way, nowadays people overfeed their cats quite a bit. I'm sure everyone knows somebody who has a way overweight cat.

I'd say only around 100k cats!

 

[in_the_loop]

No way, nowadays people overfeed their cats quite a bit. I'm sure everyone knows somebody who has a way overweight cat.

I'd say only around 100k cats!

 

[bit_user]

Spoiler: Fat Cat

🤮

 

[DoubtfulJonny]

How much by weight was the Coreweave purchase from nvidia last quarter ?

$2.3B purchase from a company nvidia has shares in ( along with numerous investment banks )..... Further, Coreweave used the $2.3B worth of H100's to collateralise the $2.3B loan they took from their financiers. Who, coincidentally, should have made a tidy profit with the nvidia price bump on the day of reporting... wow - what a great loan to Coreweave....

Unless they got a healthy discount on the purchase, the investment banks (may) have to take an immediate loss on the loan as those chips devalue as soon as they commence use....

Does anyone know where the Coreweave DC is/are ? Has anyone used their compute ? Does anyone know of any techs or engineers that work at coreweave ?

Asking for a friend.

 

[LabRat 891]

All I'm reading is
These H100s will be insanely cheap in a few years.

Too bad nVidia caught-on to AI-accelerator re-use as actual GPUs.
(Seriously, why aren't they catching flack for artificially making more eWaste?)

 

[spongiemaster]

All I'm reading is
These H100s will be insanely cheap in a few years.

Too bad nVidia caught-on to AI-accelerator re-use as actual GPUs.
(Seriously, why aren't they catching flack for artificially making more eWaste?)

I would guess the mass majority of AI accelerators Nvidia sells are using the SXM form factor which aren't usable in regular PC's. For the PCI e form factor, adding video outs would only block a portion of the back plate and hinder cooling with no benefit to the purchaser of the product. As shown in the picture below, an unobstructed back plate is critical for cooling when there is no space between the cards.

 

[Watchful Fox]

Nvidia shipped over 900 tons of H100 compute GPUs in Q2 2023, says Omdia.

Nvidia Sold 900 Tons of H100 GPUs Last Quarter: Analyst : Read more

Why are people still buying the H100s now that the H200s are available and double the computing power?

 

[Watchful Fox]

Americans will use anything other than the metric system.

And for that I am thankful.

 

[bit_user]

All I'm reading is
These H100s will be insanely cheap in a few years.

Well, here's a P100 for a mere $180:

​

NVIDIA Tesla PH400 P100 GPU Accelerator PCIe 16GB for sale online | eBay

Find many great new & used options and get the best deals for NVIDIA Tesla PH400 P100 GPU Accelerator PCIe 16GB at the best online prices at eBay! Free shipping for many products!

www.ebay.com

​

Says it was pulled from a working environment and was "tested working". Says they have a 30-day return policy.

Note: P100's have packed fp16 arithmetic, but no tensor cores. What's interesting is (besides the 16 GB of HBM) fp64 capability.


This V100 is 3x that price and does have tensor cores!

​

NVIDIA Tesla V100 FHHL Graphic Card 16GB for sale online | eBay

Find many great new & used options and get the best deals for NVIDIA Tesla V100 FHHL Graphic Card 16GB at the best online prices at eBay! Free shipping for many products!

www.ebay.com

​

So, you might have a point, there!

Note: these cards have no display outputs. However, they do have full graphics hardware. So, you could use them in a VM with pass-thru and display it on a cheap graphics card. Starting with the A100, Nvidia got rid of nearly all hardware graphics acceleration capabilities from the 100-series GPUs.

 

[bit_user]

I would guess the mass majority of AI accelerators Nvidia sells are using the SXM form factor which aren't usable in regular PC's.

They continue to offer PCIe AIC (add-in-card) form factor versions, even of the H100. You're probably right that the volume is disproportionately biased towards SXM.

NVIDIA Announces H100 NVL - Max Memory Server Card for Large Language Models

www.anandtech.com

 

[bit_user]

Why are people still buying the H100s now that the H200s are available and double the computing power?

I'm a little unclear on the naming convention, but my understanding is that they have three different options which fall in that category:

• Grace + Grace
• Grace + Hopper
• Hopper + Hopper

If you buy the version with two H100's, then presumably it would just cost twice as much. The main argument for it would be density, though presumably you'd get better connectivity (i.e. more NVLink lanes) between the two H100's sharing a carrier board.

The main benefit of the Grace + Hopper pairing is that each Grace includes 512 GB of memory (@ 480 GB/s bandwidth) + 72x ARMv9-A cores. So, it's a way that you could distribute more memory & CPU cores throughout your system, although I think it would primarily benefit only certain kinds of applications. I assume the carrier board is larger, which means you'd have lower density of compute. So, you wouldn't necessarily want that version, if you didn't need it.

Note: though I've previously read about the G+G and H+H pairings, I haven't confirmed those are real products you can currently order. All of my searches on "H200" seem to turn up "Grace + Hopper".

 

[emike09]

No way, nowadays people overfeed their cats quite a bit. I'm sure everyone knows somebody who has a way overweight cat.

I'd say only around 100k cats!

I shall take all 100k cats and they shall be mine and I will give them all scrathums and pets.

Side note, I use an auto feeder that I program the amount and timings of. My two cats kinda hate it because they want more. But once that beast releases, they go ape for it, then they come to me begging for more. And I give them skritches and loves, but not more kibbles.

 

[bit_user]

I shall take all 100k cats and they shall be mine and I will give them all scrathums and pets.

That's a lot of litter boxes to clean!

Side note, I use an auto feeder that I program the amount and timings of. My two cats kinda hate it because they want more. But once that beast releases, they go ape for it, then they come to me begging for more. And I give them skritches and loves, but not more kibbles.

I wonder if they'd still appeal to you for more food, if you'd never directly fed them, and they never saw you refilling the feeder or smelled cat food on you. I'm going to guess not.

What blew my mind is hearing that cats are trainable, using the "click" method. Had I known this growing up, I'm sure I'd have spent many hours attempting to train the family cat. It's probably for the best that I didn't.