You are not doing badly, considering a 35c. room temperature.
At one level, do not worry, your cpu will monitor it's own temperature and will slow down or even shut off if it detects a dangerous temperature.
50c. idle suggests to me that your cooler is mounted properly and functioning well.
Any cooler needs a good source of fresh air to let it do it's job.
A single 80mm fan as intake is not likely to do the job.
If the case permits, replace the front intake with a 120mm fan.
In the mean time, take the case covers off which will allow more fresh air to reach the cooler and graphics card.
A house fan directed at the innards will help more.
In case you want to remount the cooler, here is my stock instruction:
----------------how to mount the stock Intel cooler--------------
The stock Intel cooler can be tricky to install.
A poor installation will result in higher cpu temperatures.
If properly mounted, you should expect temperatures at idle to be 10-15c. over ambient.
To mount the Intel stock cooler properly, place the motherboard on top of the foam or cardboard backing that was packed with the motherboard.
The stock cooler will come with paste pre applied, it looks like three grey strips.
The 4 push pins should come in the proper position for installation, that is with the pins rotated in the opposite direction of the arrow,(clockwise)
and pulled up as far as they can go.
Take the time to play with the pushpin mechanism until you know how they work.
Orient the 4 pins so that they are exactly over the motherboard holes.
If one is out of place, you will damage the pins which are delicate.
Push down on a DIAGONAL pair of pins at the same time. Then the other pair.
When you push down on the top black pins, it expands the white plastic pins to fix the cooler in place.
If you do them one at a time, you will not get the cooler on straight.
Lastly, look at the back of the motherboard to verify that all 4 pins are equally through the motherboard, and that the cooler is on firmly.
This last step must be done, which is why the motherboard should be out of the case to do the job. Or you need a case with a opening that lets you see the pins.
It is possible to mount the cooler with the motherboard mounted in the case, but you can then never be certain that the push pins are inserted properly
unless you can verify that the pins are through the motherboard and locked.
If you should need to remove the cooler, first run the cpu to heat it up and soften the paste before shutting down and powering off the pc. That makes it easy to unstick the old cooler.
Turn the pins counter clockwise to unlock them.
You will need to clean off the old paste and reapply new if you ever take the cooler off.
Clean off old paste with alcohol and a lint free paper like a coffee filter.
Apply new paste sparingly. A small rice sized drop in the center will spread our under heat and pressure.
Too much paste is bad, it will act as an insulator.
It is hard to use too little.
----------------------------------------------------------------------------------