I currently have my 3570k at 4.7 GHz and stable with a Corsair H100i cooler using stock fans. During load I haven't gone above 75 Celsius and mostly stay around 65 Celsius during 1-2 hour Prime tests. My voltage is maxing at 1.256 with an offset of .05. When gaming and using computer in normal conditions (not rendering or playing highly intensive games like BF4 or Crysis) I stay around 44 Celsius and 1.16-1.2V.
I hope that can help you out some with your question and if I can interject, based on my information above, should I continue to reach for a higher OC? I would want it not to be for benchmarks though and actually use it on day-to-day as a constant OC.
@Lemons48 Remember though: EVERY CHIP IS DIFFERENT, even though mine is currently doing well at 4.7 doesn't mean yours may make it that high or if it does it may not have same results with heat and voltages. A friend of mine just reached 4.9 GHz on his 3570k two days ago using the same cooler as I have and so far has not had problems. I have heard of some people reaching 5.0 but you just really have to tweak and mess around with your own chip. I would also add though that if you have questions, ask and research first so that you do not ruin your system. My personal limits are no more than 80 Celsius under load for max and nothing over 75 Celsius as a constant. Voltages not over 1.31V and no more than a 1.3V constant. However, I am still definitely an amateur and my limits are just from decently extensive research over systems related to mine.