There may be a button on the router (likely a little recessed one that you have to use a pin to press). If not, you'll have to log into the router and look around the settings to find a reset option.
There are probably videos out there, but it sort of depends on how your internet is setup up. If you have a separate modem, then you may not need to do anything. Although I always set the name and password for the wireless network, and set the router login password.
The problem is, I think it's recommended to do router setup using a wired connection. I don't think I've ever tried to wirelessly connect to a router immediately reset, because I don't know what the wireless name/password would be. In your case, if it turns out the ethernet ports are busted, you may not be able to connect to the router at all. You should check for a sticker somewhere on the router (probably the bottom) that lists the default SSID(network name)/wireless password, because then at least you should be able to connect to your wireless network.
Before you do this, just keep in mind that if you reset the router you may not be able to connect to the internet at all (wired or wireless) until the router is set up properly again.