FIX I had the same problem bought a new power supply, power button, mother board, cpu, graphics card, and SSD drive. So I was FLIPPING OUT.
Solution: I unplugged everything but motherboard, graphics and fans.
My problem was a hard drive 100%
How do I know? well lets say i have 3 hard drives and my operating system is on the SSD drive and I knew for a fact that one worked so I unplugged the two SATA Hard drives the ones with spinning disc for those that don't know but anyways I got the DUMB idea to plug them in while it was running and first one spun up just fine and then the second one started BURNING and smoking.
Conclusion: It is some component inside that your power supply or motherboard is telling the power supply hey it don't work and will cause a fire do not run. So it is switching off the pc before it burns anything up like I almost did by bypassing it.
Results: I took the bad drive out and the PC runs like a charm.
NOTE: Do not do what I did because you WILL burn up your power supply I got LUCKY the SECOND time.
The first time i kept turning it off and on, off and on and it finally burnt up my power supply. 70$ mistake.