I would start by running the connection with either routers disconnected to see if anything changes. It might be that something on your network is triggering this. If it's such a regular issue, you should know within hours if there's been a change.
Next, I would perhaps look at reducing the potential for ARP broadcast storms on the network by setting up static ARP addresses. For example, on my local machine, I have the MAC address of my router set as a static address to the IP 192.168.7.1, and on my router, I have PC's MAC set static for it's IP. This reduces instances of ARP broadcast requests bouncing around the nodes of your network. e.g.
Who has 192.168.7.2? Tell 192.168.7.1
192.168.7.2 is at xx:xx:xx:xx:xx:xx
Just be sure to tell all the network nodes of the ARP addresses to eliminate these. If you're constantly changing devices, perhaps defer to DHCP, which ought to bind the first ARP request to the IP until the DHCP session expires. Not 100% sure, but I think you have to bind static ARPs when using static IPs and so on. It's been a while since I did my Cisco, so gimme a break.
😀
You can get your MAC address from "ipconfig/all". Your PC's ARP cache with "arp -a". Adding a static ARP address to your router will be between you and your router user-manual, and adding a static ARP entry to Windows:
netsh interface ipv4 add neighbors "Local Area Connection" xxx.xxx.xxx.xxx xx-xx-xx-xx-xx-xx
(First set of xxx. is the device IP (e.g. router), and xx-xx etc is it's MAC address)
Assuming it's not cables, or a specific device, look at some of the settings across the devices. Sometimes PnP can cause network issues with some devices. Some network adapters have 'Green' or 'Energy Efficient Ethernet' settings. Can't speak for anyone else, but when I had random disconnects, disabling both and doing a few other tweaks
seemed to sort my problem. It was maybe a coincidence, but you never know. I certainly wouldn't want to test my network with these enabled. I presume they are ideally aimed at large enterprises anyway, rather than home users. See image (and entry two down from highlighted):
Lastly, I would suggest considering alternative DNS servers (temporarily at least). It might not solve the problem, but it can't hurt to try. GRC offers a benchmark for this, and you can add your own ISP's servers to the mix to compare to others. I recommend 1.1.1.1 (and 1.0.0.1) as an option.
https://www.grc.com/dns/benchmark.htm