Hey, have you fixed your issue already? Recently I've been pulling my hair from this exact same issue - internet hangs for about 5 to 10 seconds whenever I open file explorer (win+E), click My Computer in file explorer or right click any file anywhere in the system. I managed to nail the issue down to media sharing services probably bombarding my USB Wifi adapter desperately trying to find my new TV that I had synced to my PC to test the screen casting feature (it's absolute garbage btw). First thing I did was to disable any and all kinds of media sharing permissions on the system (usually found under Network and Sharing), but in true MS fashion that obviously wasn't enough, I also had to check under Settings -> Devices -> Bluetooth and other devices, and I removed any and all entries related to my TV there (there was one under Audio and two under Other devices, for whatever reason). Wifi stopped acting up after that.
If you actually do use network stuff that might be causing your wifi to drop, I think your best bet would be to use a cabled connection, as that was one of the first things I validated about my issue and indeed I got no issues while connecting via the LAN cable... I went through many threads about this same issue while looking for a solution for mine, some of them got their systems fixed simply by using a different wifi adapter, that seems like a gamble with your money tho...
Every day I am closer and closer to formatting this s*** and installing Linux 🙃