i5 stock cooler too noisy

[brianthefish]

So I have an i5-4460, and I'm using the stock cooler. At idle, the temps are around 37c to 42c, so that's to be expected. It sounds like a jet engine when I try to do some gaming. At idle, the fan is at 1500 rpm, and under gaming load, it is just under 2000 rpm. Are these fan speeds normal? When I'm gaming, the temperatures are in the low to mid 50's.
How much improvement noise-wise would a hyper 212 evo bring?

 

[Tradesman1]

If it tells you anything, I throw the stock coolers away as soon as I get them The 212 EVO will be much quieter and if you want can even invest in a quieter fan