Depends on the GPU though, My 5700xt was mostly limited by temps rather than power, my 6800xt seems to be more balanced and anything over 2500mhz I seem to drop in performance a little, good temps but Im hitting a power limit.
My Vega 64, that card was something else, If overclocked the card to 1720mhz at its stock 1.2v, its max stable, that card was slower than stock 1630mhz but it was hitting its power limit pretty fast, it was 300 - 400 points slower in Firestrike, and temps were below 75C. Now if I left the card stock 1630mhz and under volt the card to 0.95v I gained near 1,000 points in firestrike, it was much faster than 1720mhz, I got the card to 1680mhz at 1v on the dot and I was gaining just over 1,000 points in firestrike and temps were at 60C, I was not hitting its power limits, I'd like to say every card is slightly different.
So getting the highest core clock isn't always better on some cards with how they limit some things. Sometimes it takes some times to figure out whats best on your card.