Ok. I seem to have found a solution, although my problem changed slightly.
The on-off-on problem went away, and was replaced by the computer just not starting unless I turned off the PSU and the wall switch, and then turned them on again.
I went looking for anything odd in the BIOS, and found...