Some of these small adapters will have USB power interference from USB itself, especially with 2.4ghz wifi signals. Some routers let you turn off USB 3.0 ports for this reason.
Here's an excerpt from a technical article about this problem:
https://www.pcmag.com/opinions/wireless-witch-the-truth-about-usb-30-and-wi-fi-interference
USB 3.0 has a 5Gbps signaling rate. The USB 3.0 specification requires USB 3.0 data to be scrambled and it requires spread-spectrum. The noise from USB 3.0 data spectrum can be high (in the 2.4-2.5GHz range). This noise can radiate from the USB 3.0 connector on a device (such as a PC or Router), the USB 3.0 connector on the peripheral device or the USB 3.0 [port]. If the antenna of a wireless device operating in this band is placed close to any of the USB 3.0 radiation channels, it can pick up the broadband noise. The broadband noise emitted from a USB 3.0 device can affect the SNR (signal-to-noise ratio) and limit the sensitivity of any wireless receiver whose antenna is physically located close to the USB 3.0 device. This may result in a drop in throughput on the wireless link.
USB 2.0 is capable of over 300mbps. I'm really doubting you'll get 300mbps with 2.4ghz wifi anyways. So you should just stick with USB 2.0. I don't think it'll be the bottleneck for you.