Those HD Audio devices are being installed with your Video card driver. The easiest way to get rid of them might be to uninstall your video card drivers and reinstall them, click Custom and untick "Nvidia High Definition Audio"
If your headset is USB then you may have to install the drivers...