A simple sounding problem that might not be so simple..
Maybe your computer power supply cord has a bad ground.
1. Get a multimeter (a test light with small battery will also work).
2. Set the multimeter to Ohms, put the leads together and see what your reading is, it should be close to 0 Ohms (a dead short).
3. With the outlet side of the cord unplugged, keep the other end into the power supply. It should read close to 0 ohms from the ground on the plug to the case.
4. Put each lead on the middle ground wire on your cord, if it's not close to 0 ohms, it's just a bad cord.
5. Maybe you case is painted and when you installed your power supply, the mounting screws are not grounding the power supply to the case. Take one screw out and scratch the paint off neatly where the screw touches the case. Reinstall the screw. (you want to only scratch the paint off where the circle mark is in the paint that the screw made or it will look like crap.)
If not the power supply has a bad ground inside.
6 A. If your home is a rental, call your caretaker DO NOT REPAIR A RENTAL.
It is likely they wont want to fix it. Run a small wire from your case to something metal like a water line to make your own grounding wire if you can. (The outside braided shielding wire on your cable tv/internet coax cable should also be grounded and work too)
Or paint or cover any metal parts on your case so that you can't spark them.
6 B. If your home lacks the third grounding lug on various plugs and was built before 1950, it might have "knob and tube wiring" and a ground wire does not exist. It is fairly common for people to "cheat" and put in a 3 prong plug when there is in fact no ground wire connected to it. If your panel has fuses and not breakers, it probably lacks ground wires.
Be careful not to touch a tap when using a appliance or your stove. No this is not so safe and this is why houses are now wired with a ground wire. Do google "knob and tube wiring" so you know the hazards of this kind of wiring.
6 C . If the above 1-5 tests checked out good. Your home might have a wiring problem. THAT IS A BIG DEAL AND VERY DANGEROUS, AND ANY GROUND FAULT PLUGS OR BREAKERS WILL NO LONGER PROTECT YOU FROM SHOCK.
Most homes are grounded to a water line, or grounding rods, some are grounded to the metal natural gas line. It could just be a bad plug at the outlet too. A corroded connection is the most common trouble. It might be as simple as the ground just dried out and needs to be watered around the grounding rods.
If your home was built between 1968 and 1986, you might have silver colored aluminum wiring. It is common for the connections to get loose or corrode. Tightening the screws normally fixes it. This wire was banned after about 1986.
A bad connection at the plug is the most common. Yes do google this too if you find out you have aluminum wiring. In spite of the bad things people say, with some maintenance it can be ok.
The grounding plug should read close to 0 ohms or light up your test light when going from the grounding lug to the left blade plug (the common). If not you have a bad ground.
(you can buy cheap testing plugs that have led lights on them that tell you this too)
http://www.youtube.com/watch?v=bDhYDY9A4TI
IF YOU ARE NOT FAMILIAR WITH HOME WIRING, CALL A FRIEND WHO IS, OR GET A ELECTRICIAN.