My cpu started staying at max voltage and max speed even at low CPU usage as you can see in the picture. I even reset the BIOS settings and it still the same.
Sounds like you have Cool N' Quiet disabled. Do you have any AMD CPU software that controls different features?
Generally it can be found in the BIOS but since you defaulted it you might be reversing the change with an OC program or something similar. Check the BIOS just to be sure that it defaults to Cool N' Quiet being enabled.