No, GPUs and CPUs can only be physically damaged from excessive heat when overclocking. Without touching voltage, your only real risk is the drivers crashing and then restarting (or at worst a bluescreen). As long as you stay within safe thermals, I wouldn't worry about pushing the voltage either.