Usually....in the BIOS.....there is a list called something like "boot order".
When you go to install Windows from a USB stick it is common to make the USB ports #1 in the boot list so it boots from the USB stick.
AFTER you install Windows....it is common to change this boot order so the hard drive is first.