Not able to undo cpu underclocking

[Lollonator]

A while ago I underclocked my cpu to decrease its temperatures, but now that I have installed new drivers I am not able to undo it. I was using amd overdrive and there was a slider to decrease or increase the power input and I decreased that. I have tried to undo it using amd overdrive but I can't get it back up completely.

By the way, I want to increase it again because my heatsink feels pretty cold for a cpu heatsink.

My system:
Windows 8.1
AMD A10-6800k with stock cooler
Radeon R7-370
550W power supply

 

[Eliasand]

Change it in the BIOS.

Also, don't use your heatsink and your hand to measure temps. Please.