Yes you can do that. I have done that too. Saga is right small screen is not convenient but it will work.
On Android go to Settings ---> Wifi-->Connect with WiFi to your router.
When it connects, click on your WiFi name shown there. You will see a IP Address, remember it. Open browser and type in that IP in your address bar, you will enter your WiFi router settings.