News AMD posts first Instinct MI300X MLPerf benchmark results — roughly in line with Nvidia H100 performance

[Admin]

AMD's data center Instinct MI300X GPU can compete against Nvidia's H100 in AI workloads, and the company has finally posted an official result for MLPerf 4.1 — for the Llama 2 70B LLM at least. It's roughly in line with the H100 but noticeably slower than H200 and B200.

AMD posts first Instinct MI300X MLPerf benchmark results — roughly in line with Nvidia H100 performance : Read more

 

[Bikki]

AMD clearly has a lot of work to be done for their software stacks if they want to compete. Good article.

 

[Pierce2623]

AMD clearly has a lot of work to be done for their software stacks if they want to compete. Good article.

I mean, realistically, anybody that’s ordered AMD parts already knows they’re significantly behind in the software stack. I’d say the main thing people are looking at if they realistically considering AMD is that the Mi300x is going to be available at like 1/3 of the price of the H100 while including a CPU in the deal, too.