First run tracert to some common ip like 8.8.8.8. Your goal is only to get the IP address of the ISP router. This is likely hop2.
Now leave a constant ping run to that ip in a background windows. You should also leave a constant ping run to your router IP in a second window. If your router always responds then your pc and router are fine and you actually are losing the internet connection. The ISP maybe jerks and still try to blame the router. You would then need to plug into the modem directly and leave a ping run to the ISP router. It should be the same IP and be hop 1 if your ran a trace.