I checked the BIOS, and didn't see anything that said something like "state after power loss".
I also tried to unplug all the USB devices, start it up in safe mode and then shut down again and it still restarted. Does that mean that there's something corrupt in the actual Windows files?