PC wont boot when hard drive is plugged in but will when its not plugged in

Jun 29, 2018
1
0
10
i5 2400 @3.1ghz
MSI H61M-P25 (B3)
4gb DDR3
80gb hard drive (Win XP, but i am currently installing win 10 on USB)
Corsair cx750m PSU

Whenever i try booting with the hard drive plugged in it doesnt work CPU Fan spins for a second then stops. When i unplug the HDD it boots perfectly fine.

I was wondering if it has anything to do with the Power supply delivering too much power to the HDD

Please help its really Frustrating XC