If you have an integrated graphics card on your motherboard (sounds like you do, given your description above), make sure to turn that off in BIOS and select PCIE as your graphics card slot. Then install your new GPU.
Also, make sure you've plugged any necessary cables into your new GPU - I believe it takes at least 1 6-pin power connector, if not 2.