It all depends on what you do with it. If your happy with the FPS you get now then don't bother with it. I only run mine overclocked when I'm playing a CPU taxing Game like GW2 WvW, 80% of the time I run everything at stock settings.
I suggest you do some research and fully understand what your doing, basic overclocking is not hard you can hit 4.5ghz by just changing the multiplier but if you want higher then you would need to start messing with the Vcore and that is where you can fry things. I never took mine past 4.5ghz I had no reason to go further I do very little now that would make use of it.
Without knowing your motherboard here is a generic guide for it...