How do they talk to each other? Are you reusing some of the PCIe lanes, like Zen 1 did? That would add latency, when a CCD on one IOD is talking to one on the other IOD. I think it's better to have a single, unified switch fabric. To get the full benefits of a single IO die, it needs to be non-cuttable. As soon as you dictate that it must be able to be cut, then the two halves of it need to be somewhat decoupled, and that undermines the benefits of having a single piece of silicon.
The main benefit I see for your scheme is if the market were too small for the smaller IO die, but they do have a mid-range server lineup that I think reuses the same mid-level socket and IO die (or, at least it
could). I agree with
@thestryker that AMD would rather just make more IO dies, if there were a benefit in doing so.
I kind of liked the original EPYC/ThreadRipper's distributed I/O. I understand why the current design is better, but there was a certain elegance to that approach.