Hello and welcome to Tom's Hardware Forums.
You need to use a cable tto connect to that router so in your computer, go Start then Run or use the Windows key plus R , then type in the following into the Open box, including all the spaces:-
cmd /k ipconfig /all
then press Enter and from the black form that shows up, take a note of the numeric code beside the Default Gateway icon - something like 192.168.0.1.
Type exit to close the black form.
Open Internet Explorer and enter that code into the URL address bar as though it was a website. You're then at the login page to the router's settings utility and admin will usually be the login with either admin or password as the password which in a Linksys the login is usually linksys and there is no password.