It may be the router, but more likely it is the wall wart power supply. You might be able to replace the power supply, but I bet you don't have time to wait around. A new router would be faster than a replacement power supply. Unless of course your router is supplied by your ISP. If so then tell them it's broke and have them send a new one.
If you get a new router, you might still want to go to E-Bay and buy an exact replacement power supply and have a backup router for the future.