Upgrading a store bought pc for a gaming pc

The parts you picked are pretty good for your budget, but you will need to get a new power supply as well. The one in your computer now is only 300 watts, which is not enough for the graphics card you picked out. Getting a GTX 750 or 950 (when it comes out) would probably work on your current power supply.

I'd suggest something around 500 watts, this'll last for a long time and leave room for a few future modifications. Corsair, XFX, and Seasonic are my top three brands for power supplies.

You'll also need an operating system. Windows will run you $100, unless you have an activation code somewhere. You could also run Linux if you don't want to pay for Windows.
 
hmmm...
Your HP PC has already 8GB DDR3 RAM and has only 300W PSU.
300W is not enough for GTX960 and the old 8GB RAM is still usable. Getting a faster 8GB does not bring much and going 16GB is not effective either.
It is better to drop the RAM you included in the link and get a new PSU.
450W should be enough as long as the PSU is a high quality one from a well-known brand like XFX, Seasonic, Antec, etc.
And, you can still go for cheaper B85 mobo if you want, but H97 is already fine.