Log into your router & look under the advanced settings. You can usually set it up to limit or prevent access for specific blocks of time, or in some cases even limit access for certain devices via MAC address during certain periods of time. Depending on the router, you may even be able to set it up to block websites.
Check your router's manual, or the manufacturer's support site, for more information on how to set it up.