Drivers from nvidia/AMD when installed, make the GPU run at advertised core clock and memory clock speeds. Windows drivers simply make the card run at the lowest power state/ clocks so it will just display an image to the monitor.
Higher core/memory clocks can and will "push" harder the coils of the GPU which after that MAY whine. It is perfectly normal and it does not affect performance in any way. It's just irritating for most people.
Solutions: There are 2 actually but none is guaranteed to work.
First one is to limit your FPS in games (Gsync, Gsync, etc). While in windows you should not hear it unless you have a video playing or similar work. You can also lower the refresh rate of the monitor.
That is the FEELSBADMAN solution.
Second one is to RMA the card IF they accept coil whine as a reason for RMA. Then you pray to lady luck and RNGesus for a card without it.
That is the ALL IN solution.