You're not wrong on the whole, but the problem here is simple: bigLITTLE introduces issues with scheduling. If you happen to be using a lot of hard threads, then the OS will inevitably move some to the lesser cores. That's just how it works. What types of threads you ask? Take Beat Saber + Mods with OBS Streaming for instance (not even taking into account Discord calls or simultaneous streaming in it). The Composite for the external view port in Beat Saber uses a lot of CPU alongside the multitude of in-game effects plus OBS streaming in the background with either software encoding or even HW. The OS can't tell if the threads from OBS are more important than the ones from Beat Saber (or its mods), so if it decides to give the main Beat Saber thread to one of the E-cores, you're in a world of hurt. This doesn't happen with my 5800X3D or even older Intel CPUs, for obvious reasons. Even if the P-cores aren't saturated, I'm sure the OS will throw some threads to the E-cores if the P-cores are all utilized, because it can't know for sure what threads are meant to run in the P-cores and never in the E-cores. Also, knowing that (which is doable) is even more load on the CPUs themselves, which is kind of ironic. You remove all these (potential) issues by not having E-cores (or disabling them).
I'm not saying bigLittle is bad, but it has its limitations and trade offs.
Regards.