I strongly urge you to use the BIOS when overclocking. However, do not just go changing everything. Google guides for your motherboard and cpu combination. You will find those far more helpful. I'll see what I can find for you. But again, the best way to learn is to have the right equipment first, try seeing what works in a slow and steady methodical fashion. You are being smart though asking questions ahead of time. That's what I did when I first got started. Also, I feel like intel should pay me for this by how often I'm recommending it but if you want the piece of mind I went ahead and purchased the intel warranty for overclocking. For $25.00 or so you have piece of mind that you are covered. Without this you are not even though oc'ing seems so common (turbo boost is a factory setting so no need to worry about that in case you did).
http://click.intel.com/tuningplan/
Keep in mind that you aren't covered till 30 days AFTER you purchase this warranty. So, if you are considering this I'd get it now so by the time you are overclocking you're covered! I'd tread lightly before then unless you are very methodical and careful not to damage anything without it. I am but I still bought it. To me what's $25.00 when you are spending 1,2 or 3k on your rig? To me it was worth the peace of mind but I get why someone would want to skimp here; just not me though! Who hasn't wasted more than $25.00 in their lifetime? If you haven't, get your butt to vegas or something and start having more fun!
Anyhow, I found this youtube vides and it will probably be a good starting point for you:
http://www.youtube.com/watch?v=-wF2S0GAGas
I am not a fan of auto settings and llc (load line calibration) as it tends to overheat your system (marginally) and create voltage deficiets at times for higher oc's when not being taxed. However, like they say in the video it's a decent starting point and I did utilize those methods when I first started as well. It won't damage anything but you may hang, crash, or get some bsods but that is par for the course when finding your sweet spot for your most stable oc. Also, their temps are about average (hit high 70s) and as you keep learning (I'll try to find better guides but you may just have to sift through some forums specific to your board; I'd show you what I've used by I have a different board, you'll probably find something before I do) you'll be more and more excited at getting closer to that optimal setting that has your system flying at pretty cool temps! Again, I don't agree with everything these guys are doing but it's not the worst way to start; pretty decent.
You'll find yourself getting anxious to try stuff but don't without the right cooler first! Some people claim great temps with just aftermarket air coolers. I have the Corsair H80i which is a simple closed system liquid cooling system and corsair link (when it works right; windows 8.1 issues but there are easy enough workarounds) gives you some great control from manipulating the LED to fan alerts and all kinds of different settings. If I were to do it again though I'd recommend pushing for the h100i if you go in this direction. For the quietness and performance it sets the standard. If you are on a tighter budget you'll find some air solutions that seem to get comparable results but I haven't utilized those solutions so I won't discuss that much further.
I just googled your case; that is a compact case! It looks great and perfect for htpc but for gaming and all the recommendations I'm making it will be very challenging if it's possible at all to get most recommended aftermarket coolers in there! Airflow is a big part of oc'ing whether you go liquid or air. Htpc cases are designed to be compact and do not have the best airflow to begin with. I'm not sure what to recommend past upgrading your case at some point.