These issues are largely due to Intel being late to the core scaling party.
I note your use of the word "largely", but here's a counterpoint to the notion that even their recent dip is really just about core counts. Here's one matchup I hope you'd agree is fair: Xeon 6980P (Granite Rapids 128 core) vs. EPYC 9755 (Turin 128 core). SMT and full AVX-512 in each. Even the process nodes are similar, with Intel at an apparent advantage: Intel 3 vs. TSMC N4
Intel even had a significant memory bandwidth advantage, via their MRDDR5-8800. As noted in the article, something weird is going on with Intel's dual-CPU scaling, but you can just ignore that and focus on the 1P vs 1P case, where AMD is still a whopping 18.4% faster. They average similar power, with Intel at 331.8 W vs. 324.1 W for the AMD CPU.
That said, we can see some prior generations where Intel is faster on a per-core basis. However, the article notes that Intel's unit sales
still decreased in the Xeon 6 era, even though it was competing against the older Zen 4-based EPYCs for part of the last quarter. The article blames this on customers simply not needing as many CPUs as before, due to their higher core counts (to paraphrase: "they're just
too good!" LOL).
"unit sales of Intel server CPUs declined slightly once again as customers switched to high-core-count models."
The article then notes that ASPs have increased, but the latest news on that front is Intel slashing prices. So, we'll see how ASPs hold up and whether they can drive enough unit sales to make up for it.
There are plenty of reasons for this, but I think hubris amounts to the underlying factors.
For Ice Lake, Intel probably planned it way back when they thought it'd be competing against 32-core EPYC. So, I can give them a pass on that one.
Sapphire Rapids marked an attempt to shift strategy so they're no longer competing on raw core-count, but instead have special-purpose accelerators to give them an edge. It didn't seem to work out very well, overall. However, I'm sure it was enough to maintain a lead in some specific workloads. However, Sapphire Rapids was a victim of its own ambition, with Intel going slightly nuts on the whole "tile" thing.
Emerald Rapids was really what Sapphire Rapids should've been, but it came too late and couldn't keep up against AMD's 96 Zen 4 Genoa or its 128 Zen 4C Bergamo.
Qualcomm's delays getting Centriq off the ground (before it was canceled) likely led to executives dismissing the Arm threat. That time is when they needed to be formulating what the high core count/occupancy part response would be.
I think it's precisely around that time when they must've started planning the 144-core Sierra Forest. If we go back and look at their roadmaps, Sierra Forest probably appeared too soon to be a response to Ampere Altra.
I also don't think they thought AMD could scale up the cores so quickly. and that it would only take 3 generations to get a solid platform.
I agree with this up to 2019's launch of the Zen 2-based Rome EPYC. After this, it should've been clear that AMD could easily scale further. The CCD chiplets were relatively small, so even if they just increased them to 12 cores, such a CPU would've been pretty viable way back then. Probably the main thing holding it back was just DRAM capacity.
Intel's hubris of being able to out-scale AMD took the form of making their cores much bigger, which really hurt them in the core-scaling race. Once they settled on their P-core vs. E-core strategy, I think they lost any remaining reservations and just went nuts on core size (e.g. AMX). However, their E-core Xeons were too far behind to properly support this strategy.
CWF is Intel's chance at retaining and even capturing more of the cloud market, but it really needs to launch sooner than later. I think whether or not Intel makes a pivot to another architecture for this segment hinges on CWF.
It's going to launch later:
Intel delays key Xeon data center processor amid massive losses — Clearwater Forest pushed back to 1H 2026 Intel delays key Xeon data center processor amid massive losses — Clearwater Forest pushed back to 1H 2026 : Read more
forums.tomshardware.com
Also, I disagree it's the final make-or-break for Intel. They could still switch ISA. Even if they skip ARM, due to licensing costs & other concerns, RISC-V should be a viable option and they could take an early lead in that segment. It'd be fascinating if AMD jumps on the ARM bandwagon, while Intel joins the wave of RISC-V upstarts trying to rain on their parade.
Something I don't think a lot of people outside of the industry consider is that the majority of server CPUs are middle of the stack. This was one of those places where AMD really stuck it to Intel with Zen 2 because Intel's top end was 28 cores and AMD's middle was 32.
Yeah, it's worth looking at how their respective value scales down. Also, AMD and Intel have both responded to this need with a smaller socket to help reduce platform costs. Somehow, I'm doubtful it's going to look much different.
The high core count systems are the ones replacing racks worth of older servers and I suspect with all of the CXL memory devices launching this year the rate of replacement will increase. It seems like CXL should be one of the biggest data center drivers over the next few years.
It'll be interesting to watch.