That's totally normal, all CPU heatsinks are PWM, they automatically adjust fan speeds according to CPU average temperature. I suggest if you have a spare PSU, try it out.
Typically I suggest good quality PSU's because they avoid complications, try at least Bronze 80+ category. I personally...