Well the computer was working fine until I put the graphics card in. I switched it to an older computer and the card worked great in there. Tried all 3 PCI slots and that didn't fix it.
Basically any time Windows tries to do something and I have the GPU enabled, it just freezes and restarts at the "Starting Windows", don't even get a BSOD.
I've tried a bunch of fixes, for some reason reinstalling Windows let me get like 10 seconds further than before, I thought it might have been because the HDD had a big chunk of unallocated space, but that didn't seem to be it.
Now I'm thinking it might be because my PSU only has 6+2 PCI pins instead of just a straight 6. Maybe it's not getting enough power?