For all of you having this problem:
I recently got an old PC with the exact same problem and I fixed it. I don't know if it's the solution for all the cases, but it's a cheap option before trashing your motherboard or PSU.
You need a multimeter, a soldering iron, a lamp and some capacitors.
1...