News Micron says high bandwidth memory is sold out for 2024 and most of 2025 — intense demand portends potential AI GPU production bottleneck

[Admin]

Nvidia buys Micron's HBM3E supply for calendar 2024 and 2025.

Micron says high bandwidth memory is sold out for 2024 and most of 2025 — intense demand portends potential AI GPU production bottleneck : Read more

 

[DavidLejdar]

Somewhat ironic, for memory to be the bottleneck, isn't it?

 

[bit_user]

This could be just the window of opportunity needed for competitors like Tenstorrent and Cerebras to gain a meaningful foothold in the market. Their solutions rely primarily on SRAM that's intermingled with the compute engines, on the same die. I'm not sure if either use HBM at all, but I know Tenstorrent's earlier hardware didn't.

 

[Co BIY]

3x the wafer for the same bits ?

That explains the expense involved.

 

[bit_user]

3x the wafer for the same bits ?

Yeah, I wonder how much of that is from the TSVs...

That explains the expense involved.

I wonder how much expense is added by the stack assembly, itself (as well as post-assembly yield).