Sounds like your power supply is not big enough to support the card. Can you answer a few simple questions so that we can assist you?
What graphics card is it you have installed?
How many watts does your PSU have and how many amps are available on the +12V rail? (all of this info can be found on the sticker on the side of the PSU inside the cover).
If you do need to new PSU, be sure to go for a high quality one because it is a crucial part of the system and a low spec one could damage parts of your computer. Running a PC without enough power is actually more damaging to the system than with too much. So I would recommend taking the graphics card out and putting the old one back in until this is resolved.