News Huawei releases new tool to get Chinese firms around crushing HBM export blacklist — new UCM software claims up to 22x throughput gain and 90% late...

[Admin]

Huawei's newest software tool, called the Unified Cache Manager, seeks to optimize utilization across the traditional cache hierarchy for AI inference, allowing China's AI firms to be more competitive without the need for exotic HBM memory that is near-impossible to obtain in the country.

Huawei releases new tool to get Chinese firms around crushing HBM export blacklist — new UCM software claims up to 22x throughput gain and 90% late... : Read more

 

[ottonis]

All politics aside, it seems that constraints can serve as a driving factor for outside-the-box-thinking and for developing creative and ridiculously effective solutions.
This reminds of the old 8-bit gaming times (commodore 64,), or later DOS, where game developers had to work around massive limitations regarding memory size, computational speed and the limited number of available colors, and still managed to create stunning gameplay, eye-pleasing graphics and just games that were extreme fun to play.
So it's no wonder, when a company that employs hugely talented developers and programmers strives to new heights when challenged with restrictions.
From a technolgical perspective: Kudos to these programmers, as their solution is something that can ispire similar solutions in the western world.

 

[jg.millirem]

This universal caching seems like a great idea for more than just AI uses. Why don’t we see it on our plain old client PCs?