The noise you are referring to occurs whenever a device is connected or disconnected. Devices other than USB can cause the sound. You may want to double check any digital connections to monitors. If the monitors are the culprit, you may need to update your graphics drivers to resolve the issue.
Otherwise, you may also want to leave a
Device Manager window open so that you can watch for devices disappearing and reappearing. Simply right click down in the bottom left corner where you would launch the Start Screen and select Device Manager from the administrative tools menu.
Other possible connections which could cause that sound could include Bluetooth and FireWire devices.