Go into BIOS and change boot priority. If you change it to one of your hard drives, it'll boot first from one of those.
You just need to either remove USB from boot priorities, there's an option there "bootable USB" disable that.
Or move it down the chain (using + and -)
So, yes you can still use your USB as normal