I see. Now that you mentioned the BIOS... i updated it recently. Could a new version be causing this issue? Should I revert to an older update? I'm not too familiar with all the BIOS settings.. I did a bit of homework regarding the voltage settings and it appears that may be my best bet to get the temps back under 30 C..
I tried the Maximum processer state, moved it to 99% and made one hell of a difference... but obviously lost CPU freq.
A new/different BIOS wouldn't cause it, just make it apparent. This really should be a different thread as OP's got a 3600, but in your case reverting BIOS is not a good idea for Ryzen 5000. You want the latest as it resolves other issues, mainly like USB ports dropping out.
Messing with voltage settings will only hurt performance, or risk damaging your CPU, if not done properly. Best thing is to leave them in stock if you're not sure of what you're doing. The boost algorithm is well enough optimized that even hard-core overclockers only manage minor performance improvements, usually at the expense of lightly threaded performance.
But lastly: this isn't really a problem if your CPU temperature under load is under 90C. Preferably in the 70's but it depends on the exact processing load; something like CB23 may get in the 80's or even touch 90 as it has a lot of AVX instructions. The CPU is designed for it, though, don't worry it. Just make sure your water block is properly mounted.
If maintaining an exceptionally low temperature at idle outweighs over all system performance in importance there are better ways than lowering voltage. Enable Ryzen's Eco-Mode, for instance, that effectively lowers the TDP of the processor. It was implemented to help the processor run cooler when installed with m-ITX motherboards in tiny cases that simply can't provide adequate cooling. It still allows the CPU to perform well in light workloads, somewhat like a laptop.