pc wont power up when gpu is plugged in.

Please help! My son and I just completed or first new build. The PC won’t power up when I plug the GPU in. If I unplug the GPU the pc will power up. I can see the GPU light up when it’s not plugged in. As soon as I plug it in I get nothing when I press the power button. Any help would be...