6-Reticle-Sized Processors will have a 12,288-bit Memory Interface.
Pumped Up Procs: TSMC Planning Chips 3x Bigger Than Today : Read more
Pumped Up Procs: TSMC Planning Chips 3x Bigger Than Today : Read more
That's not what the H100 launched at. It's costing that much mainly due to the recent demand surge. IIRC, they could be found online for like $18k, when I checked last November.To put it in perspective, NVIDIA's H100 accelerator, which is already multiple reticles in size, is priced at about $30,000. Given this, larger and more capable chips developed with the CoWoS-L technology would undoubtedly cost significantly more.
I'd expect phase-change immersion cooling to gain in popularity. Many of those buying such expensive processors and paying so much to power them probably won't mind the added cost of such kit.there is another major challenge: cooling