It depends. On graphics point of view yes, but cpu affects in so many things, things like loading times.
But if the only thing that you want is to play gpu heavy games then yes processor doesn't matter that much. On the other hand games that might on average play well, might have moments like...