Well, if you pair a very low end CPU (lets say Core 2 Duo from 8 years ago) with a high-end GPU (like a GTX 980) the processor will limit the performance of the GPU.
So, this all depends on the specific parts. But to answer the question, the CPU can cripple the performance of the GPU if they're not spec'd correctly.