News Elon Musk fires up ‘the most powerful AI training cluster in the world’ — uses 100,000 Nvidia H100 GPUs on a single fabric

[Admin]

Tech baron Elon Musk has taken to Twitter/X to boast of starting up “the most powerful AI training cluster in the world.” Today, xAI’s Memphis Supercluster began AI training using 100,000 liquid-cooled Nvidia H100 GPUs connected with a single RDMA fabric.

Elon Musk fires up ‘the most powerful AI training cluster in the world’ — uses 100,000 Nvidia H100 GPUs on a single fabric : Read more

 

[JRStern]

Just tells me his technology is 2-3 years behind bleeding edge.
Could it be he doesn't yet understand how much more it takes than the hardware training time, to get this stuff working?

 

[Eximo]

Did they ever resolve that he purchased/preempted those GPUs for/from Tesla and handed them over to xAI? He was sued last month.

 

[why_wolf]

Because he needs to inflate his stock price (even though he actually stole resources from Tesla and diverted them to his privately held company) with pointless stunts like this.

 

[hotaru251]

Could it be he doesn't yet understand

musk in simplest of terms.

 

[JRStern]

musk in simplest of terms.

Still, he's more fun than a barrel of monkeys.

 

[NinjaNerd56]

Oh great…SkyNet was created by Musk in this timeline.

 

[garrett040]

elon is the best, im sure ai will have less bias and idealogical.

 

[t3t4]

It appeared to signal that the tech tycoon didn’t have the patience to wait for H200 chips to roll out, not to mention the upcoming Blackwell-based B100 and B200 GPUs. This is despite the expectation that the newer Nvidia Blackwell data center GPUs would ship before the end of 2024.

Well, there's is no time like the present!
The next latest and greatest is always right around the corner. But you'll spend your whole life waiting if you take that approach to a thing. Doing a thing now is still doing something..... Whereas waiting on a thing is doing nothing at all. But when in doubt, doing nothing is often the best action to take. All make sense?
Good 😁!

Elon knows what he's doing, he'll bank coin on this for sure.

 

[Eximo]

Just to clarify, I am no Tesla fanboy. In fact I have a Polestar 2.

Tesla is probably going to start devaluing somewhat when it comes to automotive due to EV sales slipping, but they have a pretty broad business at this point. Battery, Solar, robotics, manufacturing technology they developed out of necessity.

Value:
1) They were a newcomer to the automotive industry, as such they basically skipped the traditional dealership model. Only now are there 'dealers' (Another side effect is rather than a massive old style warehousing system they were able to take advantage of just in time manufacturing/logistics philosophies)
2) They pushed computerization to a higher level in the automotive industry, some speculated this was another business model avenue, but hasn't panned out yet. (Self driving)
3)Early days they couldn't make enough cars to meet demand, so their price was high.
4) They vertically integrated the crap out of their production so profit at every level. That meant those high prices were a profit boon until recently but has also let them control the market price of new EVs to some extent.
5) They are still ramping up repair, parts and service. This should be another profit center in the near future.
6) Tesla charging infrastructure is still superior for the moment. This may flip now that NACS is set to become the actual standard.
7) Heavy duty. Semi trucks to start, but that drive train hopefully makes its way into other things. Garbage trucks, city buses, etc. Not the only one that can provide this, but they certainly have the range advantage at the moment.

Probably more, but I don't see Tesla as a bad company. They will get better as they have been doing. I still think true self driving is decades away, but advanced cruise control seems to be a fairly solved problem now.