The microphone should install flush and do so smoothly.
Does the microphone USB plug fully fit into other USB ports?
If so, then the problem is within the USB port shown in the photograph.
Do not force the plug in.
Power down, unplug power cord, and inspect USB port and plug.
Use a bright flashlight to determine what is preventing the plug from going into the USB port.