Depends on the model of the PSU (which one is it?). If it is a quality PSU, this is coil whine - nothing dangerous but unpleasant to hear. In crap PSUs, this can be many things, so swap immediately.
EDIT: It can also be a loud or bad quality fan in your PSU. Hard to tell precisely with all the components running.