Update:
If you have CPU fan control setup the noise will get much louder under CPU load. For example, running Prime95 or the Intel diagnostic:
https://downloadcenter.intel.com/download/19792/Intel-Processor-Diagnostic-Tool-64-bit-
I see no difference but I have an expensive CPU cooler. You should see a huge difference once the CPU stress part of the diagnostic starts.