Question Question about Redundant Memory Controller in RTX 4090 and AD102 Architecture

Jun 5, 2023
13
0
10
Hello everyone,
I recently came across some specifications and descriptions of the RTX 4090 and the AD102 architecture. While comparing the two, I noticed a discrepancy that I would like to understand better. Specifically, I found that the RTX 4090 is said to have 11 GPCs and a 384-bit memory interface, while the AD102 architecture is described as having 12 GPCs, a 384-bit memory interface, and 12 32-bit memory controllers.
What confuses me is what happens to the one redundant memory controller in the RTX 4090, given that only one memory controller is needed for each GPC. I'm curious to know if someone can help shed some light on this matter.
From my understanding, a memory controller acts as an intermediary between the graphics card and the memory modules, managing the data transfer between them. Each GPC in the AD102 architecture is associated with a 32-bit memory controller, which makes sense considering the 384-bit memory interface. However, this leaves me wondering about the purpose of the additional memory controller.
Also, can somebody explain to me what happens after CPU sends data to GPU via PCIe? Where does the PCIe connection end up and what is done with the data before processing it in SMs?
Thank you in advance for any insights you can provide!
 
That's the full ADA die you are referring to.

The full AD102 GPU actually includes 12 Graphics Processing Clusters (GPCs), 72 Texture Processing Clusters (TPCs), 144 Streaming Multiprocessors (SMs), and a 384-bit memory interface with 12 32-bit memory controllers.

The remaining one and a half GPCs and the accompanying TPCs/SMs are disabled to improve yields, or are kept for a future SKU like the Ti or SUPER variant. Coming to the SM (Compute Unit), NVIDIA has a habit of rearranging it every generation, especially the core counts and the ratio of the INT32:FP32 cores per cluster.

So unlike the fully unlocked RTX TITAN Ada, which uses the same GPU but has all 18432 shaders enabled, NVIDIA has disabled some shading units on the GeForce RTX 4090 to reach the product's target shader count. It features 11 GPCs, 16384 shading units, 512 texture mapping units, and 176 ROPs.

The same for memory controllers.