The Blu-ray/DVD burner wasn't even in the boot order and it still caused a slow boot time.
Long story short for anyone reading this thread in the future:
Unplug all USB and all internal devices (like SATA for example), even disk readers/burners and see if your boot time is back to normal.