It can be both of those problems.
Also, it may just be a wonky connected power button - my PC wouldn't start, because I connected the cable from power button poorly to the motherboard.
Try to first unplug and plug again the cable from power button to the MB.
If that doesn't help, try using some other PSU. Maybe from your other PC, or borrow from a friend, if you can.