News AMD claims RX 7900 XTX outperforms RTX 4090 in DeepSeek benchmarks

[Admin]

AMD has published benchmarks of DeepSeek's AI model with its flagship RX 7900 XTX that show the GPU outperforming both the Nvidia RTX 4090 and RTX 4080 Super using DeepSeek R1.

AMD claims RX 7900 XTX outperforms RTX 4090 in DeepSeek benchmarks : Read more

 

[gg83]

Amd just trying to pump their stock a little.

 

[Neilbob]

Our AI thing AIs more AI than the AI thing of the other AI with this AI.

I'm just so very weary of everything. And AI - I'm weary of that too.

 

[phxrider]

In other news, Congress begins talks on embargoing exports of the 7900XTX to China.....

Maybe this illustrates the differences when software is explicitly written for one or the other? I'm pretty sure most games are written for Nvidia seeing as they own something like 85% of the market, except there are a few AMD sponsored games that do much better on AMD. Could this be the same effect? It's not too hard to figure out the Chinese might try writing this for AMD since the 4090 is embargoed, and 7900XTX is not.

 

[Makaveli]

This should all be taken with a pinch of salt, of course, as we can't be sure how the Nvidia GPUs were configured for the tests (which, again, were run by AMD.

I was testing this in LM studio last week in the LM Studio discord with a 4090 user there is no grain of salt needed its been verified.

on the 7B, 8B, 14B models the XTX is faster. The 4090 alittle faster on the 32B model about 4%

 

[systemBuilder_49]

I can hear the howls of anguish as all the NVidia-buyers LOSE THEIR MINDS over this fact ...

 

[bit_user]

This should all be taken with a pinch of salt, of course, as we can't be sure how the Nvidia GPUs were configured for the tests (which, again, were run by AMD).

It's plausible, since the 7900 XTX has about the same memory bandwidth as the RTX 4090 and better bandwidth from L2 and L3 caches. So, if inferencing these models is bandwidth-limited and not compute-bound, then I could believe the 7900 XTX is holding its own against that GPU.

I didn't find an official number indicating how many TOPS the 7900 XTX is good for, but the number 123 did pop up. This is only 37% as much as the amount of dense TOPS as Nvidia (and halve that, for matrices with optimal sparsity).

Spoiler: RTX 4090 Bandwidth vs. size

Source: https://chipsandcheese.com/p/microbenchmarking-nvidias-rtx-4090

Spoiler: RX 7900 XTX Bandwidth vs. size

Source: https://chipsandcheese.com/p/microbenchmarking-amds-rdna-3-graphics-architecture

The RDNA 3 architecture the RX 7900 XTX is based on is capable of matrix operations, supporting BF16 and INT8.

It turns out that the WMMA instructions in RDNA 3 are simply microcoded operations that utilize the same vector pipelines as normal shader arithmetic. So, RDNA 3 does not have something akin to Nvidia's Tensor cores in its client GPUs (the CDNA-based server chips do have dedicated Matrix units, however).

 

[Amdlova]

AMD trying to profit... Us authority sign to block the GPU from amd to chinese market. Good move AMD.