You don't have to increase your voltage to OC, only if your CPU doesn't run stable when you OC'ed it you could raise it.
Try to raise the FSB or the multiplier, if it can be done with that board and CPU.
My case has so many fans that it hovers above the ground 😱 .