A shock indicates a bad ground, as Someone said, it's dangerous for you, if that current passes through your heart it's game over.
A bad ground can also potentially cause errors in the PC, as ground is used as a reference for 0's. It starts carrying voltage high enough, the machine will no longer be able to differentiate 0's and 1's.
The entire power path needs to be examined.
verify the outlet is wired correctly and grounded.
Verify the power supply is properly grounded to the ground pin and not the inside of the casing if you can see inside without opening it up. Never open a power supply unless you know for sure what you are doing, it is a high energy component and one misstep can easily injure or kill.
Make sure the motherboard is properly anchored to the chassis, and that none of the solder points are touching the case, and that all the power connectors are properly secured.
Keep unused connectors bundled away from metal parts, or if it's a modular PSU, remove them.
If everything else checks out but it's still zappy, replace the PSU, something's gone wrong inside.