The CPU I have is also the I5-4670K. I have chosen not to overclock it.
For the first 8 months, I ran it with the stock Intel cooler. Then one day, my system started throttling, and I discovered that the CPU fan was not spinning. When I discovered this, it was because I was in my BIOS looking for something that might be causing the throttling, and noticed that the CPU temp was at 95c. Until that point, I had not looking inside the case. I powered down, opened the case, and powered back up. Saw the fan was not spinning, and shut the power off. I used another machine to order a Cooler Master 212 EVO, and the next day I installed that. Once it was in place, I downloaded SpeedFan, and started monitoring my temps, both in and out of games.
Right now, I see the CPU at 37c. In games, I see temps ranging from the low-40c, to about 60c. GTX 770 ranges from 37c to about 65c, but I do have the video card limited to 60 FPS in the games I play.
I know that no two CPU's are the same. But I do not see my CPU ever getting much over 60c.