I don't know about the typical background noise level of this particular headset, but you might find it helps if you go into Windows volume control, and mute the playback of any input sources, so that you don't hear them playing over your speakers/headphones. Even if your standard 3.5mm line-in and mic jacks don't have a microphone plugged in, or that microphone is turned off, they can still potentially each contribute a bit of noise. Muting their playback won't prevent them from recording, but you won't automatically hear them over your speakers, eliminating any noise they might contribute. You can even mute the playback of your USB headset's mic if it's active and you don't mind not hearing yourself over it.