You are correct. Usually the GPU has much, much greater impact than the CPU. I'd rather have an i5 and a GTX 970 than an i7 and a GTX 960. At least for gaming anyway!
The people who promote CPUs over GPUs (in gaming) are usually the same people who think memory is storage space.