Apparently I could order the new PSU and send it back if it didn't fix my problem, so I have ordered it and it should arrive in a day or two.
But until then I will definitely try to fix the issue and I'm going to try clearing the CMOS. I think the BIOS is latest version, I flashed my BIOS about...