Update: I disconnected the graphics card and the computer stayed on. So I thought: Oh, great. I just need a new graphics card then. I bought one, installed it, turned on the computer and ... it shut down after a minute.
Ok, then there's really only the CPU left. It's the last thing I have not...