Try holding down: Command-Shift-Option-Delete together while the computer starts up. This is an older command that used to work in early versions of OSX.
If you can boot from the internal HDD without a problem, open your system preferences and select "Start-Up Disk." You can probably choose the external disk from there and restart.