Need help upgrading an HP Pavilion p6310y with new power supply/graphics card to do some light gaming

[aztec34]

The Specs: http://support.hp.com/us-en/document/c01959720
The Motherboard: http://support.hp.com/us-en/document/c01925562

Should I try upgrading it by adding a new power supply and graphics card? My desktop has 8 gb of ram installed already but it's making a weird loud noise whenever I boot it up but it only happens a couple times. I opened up the case and I discovered it was coming from the PSU. That is why I want to upgrade the power supply. My budget is $120 or less for both the power supply/graphics and some case fans if that fits in the budget. I'm having a friend come over to help me install the components.

 

[cdabc123]

put in a gtx 750 ti you will see a massive differnce

 

[VexenTheMexican]

With a budget of $120 it is totally possible to update that computer a bit. I recommend a corsair PSU cause that is what I use and personally I love it. Been through a ton of crappy ones (One that totaled my PC, so don't cheap out on this) and corsair came through and provided a quiet, sleek, and safe PSU. As for the GPU, I'd start small(ish) and make your way up. With the estimate remained of the budget after that, you could obtain a Radeon r7 250 card. I had a similar card when I started gaming on my PC. After some time you could sell it and get a newer graphics card, just upgrade your CPU first, it'll probobly bottleneck newer GPUs.