The fact that it doesn't make noise in BIOS and does when booted up to Windows, means the noise is generated under load. Even when in idle there are background operations constantly running in Windows and hence the relatively higher load than BIOS.
Noise can only be generated by moving part...