Well, here's the fun part then. I've had this happen to me before and it's not good...
Unplug everything until it's only the PSU, Motherboard, CPU and it's fan, and one stick of ram. SATA cables should be disconnected and the GPU should be removed.
Obviously this wont turn your monitor on but this problem is not a good thing.
If it still does the "kick" but wont turn on then try a different ram stick.
If it still does it then pull all ram sticks out and try again.
If it still does it...... Not good.
If you make it here, the PSU needs to be tested in another computer that you know works. Even better, have the PSU from that computer power this one.
If you put your PSU in the other computer and it works fine.... Test...