So after 4 hours, some meddling in BIOS, couple restarts (soft ones, PSU never fully turned off) and full instalation of Windows I turned the PC off.
And the problem came right back. Can't turn the PC on. Once it's on, all is good. No stability issues, no dead rails, nothing. All works like...