News AMD claims LLMs run up to 79% faster on Ryzen 8040 CPUs compared to Intel’s newest Core Ultra chips

[Admin]

AMD has published performance slides of its Ryzen 7 7840U dominating Intel’s latest Core Ultra 7 155H processor in a plethora of large language model benchmarks.

AMD claims LLMs run up to 79% faster on Ryzen 8040 CPUs compared to Intel’s newest Core Ultra chips : Read more

 

[newtechldtech]

Who cares ... Apple M3 pro outperform them both...

 

[Eximo]

And it is the GPU doing the heavy lifting anyway. Is anyone surprised?

 

[usertests]

And it is the GPU doing the heavy lifting anyway. Is anyone surprised?

The NPU in Strix Point will have around tripled performance, possibly outperforming the iGPU and CPU on its own.

 

[Alvar "Miles" Udell]

Last I saw the Ryzen 8040 was rated for 39TOPS, which is less than the 40TOPS Microsoft requires to be labeled an "AI PC", so does it -really- matter that it's faster (supposedly) than Intel if it's still slower than requirements?

 

[Notton]

Who cares ... Apple M3 pro outperform them both...

You mean under-performs both?

M3 only does 18 TOPS

Core Ultra is max 34 TOPS
Ryzen 8040 series is max 38 TOPS
Snapdragon X Elite claims to do between 45 to 75 TOPS.

 

[scottslayer]

Wow, I sure am glad AMD gets to self report results again.

 

[Amdlova]

Amd self claims is the pure truth =]
You can belive lol

 

[hotaru251]

Amd self claims is the pure truth =]
You can belive lol

thats how all 1st party stuff is.

They will always use cherry picked results that make theirs look good.

 

[usertests]

You mean under-performs both?

M3 only does 18 TOPS

Core Ultra is max 34 TOPS
Ryzen 8040 series is max 38 TOPS
Snapdragon X Elite claims to do between 45 to 75 TOPS.

You're comparing the Apple M3 Neural Engine (NPU only) to Intel/AMD using CPU+iGPU+NPU all at the same time, so not exactly fair.

https://en.wikipedia.org/wiki/Apple_M3#Variants

Apparently the iPhone 15 Pro's NPU is almost twice as fast as the M3 variants.

Despite the months of hype, Snapdragon X Elite isn't out yet. AMD will also be doing 45+ TOPS out of the Strix Point NPU by the end of the year.

 

[Notton]

You're comparing the Apple M3 Neural Engine (NPU only) to Intel/AMD using CPU+iGPU+NPU all at the same time, so not exactly fair.

https://en.wikipedia.org/wiki/Apple_M3#Variants

Apparently the iPhone 15 Pro's NPU is almost twice as fast as the M3 variants.

Despite the months of hype, Snapdragon X Elite isn't out yet. AMD will also be doing 45+ TOPS out of the Strix Point NPU by the end of the year.

Well if Apple doesn't want their M3 to look so badly, maybe they would plaster ads about the total TOPS?
Seeing as they don't, M3 has 18 TOPS.

Snapdragon X Elite launch date is 24'Q2, and it's been well known for some +4 months right now.

Strix Point, or 8050 series is 45~48 TOPS, yeah.

It will be interesting to see if X Elite will have a paper or hard launch. AMD mobile parts have always been paper launches that show up some 3 to 6 months after announced.

 

[Sleepy_Hollowed]

Sounds about right.

Intel slept on their integrated GPU performance maybe for almost a decade.

AMD has made some really good moves on the 64 bit realm they created, hope they can keep it up, since I would lose it if Intel is the only game in town and they keep prices high and performance stagnating.

 

[newtechldtech]

You mean under-performs both?

M3 only does 18 TOPS

Core Ultra is max 34 TOPS
Ryzen 8040 series is max 38 TOPS
Snapdragon X Elite claims to do between 45 to 75 TOPS.

M3 pro or max ?

 

[AkroZ]

Last I saw the Ryzen 8040 was rated for 39TOPS, which is less than the 40TOPS Microsoft requires to be labeled an "AI PC", so does it -really- matter that it's faster (supposedly) than Intel if it's still slower than requirements?

8040 has 16 TOPS on the NPU, Microsoft require 40 TOPS on the NPU for an AI PC.

 

[artk2219]

Who cares ... Apple M3 pro outperform them both...

Anyone that doesn't want to get locked into an authoritarian vendors ecosystem.

 

[Notton]

M3 pro or max ?

IDK man, it's probably 18 TOPS across the board, because there are no other numbers.

 

[kealii123]

Anyone that doesn't want to get locked into an authoritarian vendors ecosystem.

I get the concern with Apple, but man windows 11 is so bad. Its an OS entirely built on spyware and adware.


The TOPS value doesn't matter; running LLMs is a dance between the NPU, iGPU, and CPU. When it comes to actual performance, neither Intel nor AMD is close to Apple. Qualcomm is making some bold claims, so we will have to wait to see.