Unless your computer room is fairly warm, or you OC'd the CPU, the stock cooler should have been OK. So don't rush out to buy an aftermarket cooler just yet.
First off, is your case tucked away in a spot with bad airflow? My old computer desk had a "cubicle" for a tower case...but while the section had a door (I suppose so that you could close it when not using the PC) it also had the rear covered (typical "cardboard" backing with two 2" holes for "cable management"), & the old system tended to have heating issues (lost a CPU that way). I had removed the backing portion to free up some airflow, but airflow was always an issue. My newer computer desk, though, eliminated it completely -- it's an actual office desk, & my mid-tower sits out in the open so airflow is completely unrestricted. Make sure your case isn't restricted in its airflow -- nothing like having the hot air exhausting out the back only to be sucked back into the front instead of cooler air to really roast your CPU & HDD.
Second, how many case fans do you have? If you've only got the default rear exhaust fan, it wouldn't hurt to add at least 1 front fan so that more cool air is sucked inside. And most mid- or full-tower cases can usually fit at least four 120mm fans (2-3 intake, 2-3 exhaust), so you can easily max out your case fans for under $20, while vastly improving your temps. I have the same CPU (see signature) with the stock cooler, & idle temps usually stay below 40C, & even in BF4 gameplay I usually top out around 57-58C max.
Third, have you tried reapplying the thermal paste & reseating the CPU fan? Sometimes, if it's not properly applied or installed, it doesn't make good contact with the CPU. Good contact is essential to prevent overheating.
Finally, did you OC the CPU? If you OC'd it but kept the stock cooler, that's going to cause a major heat issue.