OP, I did notice the same problem as yours. I use a win10 with xbox one usb wireless adapter. All drivers updated.
I also noted that if I start the machine with the wireless adapter already connected, the fps problem simply goes away.
Very strange.
Now when I physically connect the wireless...