Yes, the power supply is NOT something you want to cheap out on.
I've heard and read many stories of cheap power supplies, where when you even approach capacity - let alone reach it - bad things happen. Here is just another example.
I think you can guess what's the problem with the computer...