News Samsung claims its new AI chip is 8x more power efficient than Nvidia's H100

[Admin]

Samsung and Naver team up for power-efficient inference chips, tout eight times higher efficiency compared to Nvidia's GPUs.

Samsung claims its new AI chip is 8x more power efficient than Nvidia's H100 : Read more

 

[bit_user]

I'd be more impressed if they compared against the H100 running at reduced clock speeds. The stock speeds doubtlessly push the H100 well outside of its efficiency sweet spot.

I do believe there are big efficiency gains to be made via PIM (Processing In Memory), which I'm expecting they are doing via their hybrid HBM approach:

Samsung Processing in Memory Technology at Hot Chips 2023

At Hot Chips 2023, Samsung showed its Processing in/near Memory ranging from PIM-HBM in AMD MI100 test GPUs to LPDDR-PIM and CXL-PNM modules

www.servethehome.com

Nvidia is apparently working with Samsung's competitor on an answer:

https://www.tomshardware.com/news/sk-hynix-plans-to-stack-hbm4-directly-on-logic-processors