Check the power connectors to the motherboard as well. Sometimes if the 4/8pin CPU power connector or the 24-pin motherboard connector are not seated properly it'll start up, but not work right.
I've also seen this to be the case if the CPU isn't seated properly. Do you get any beeps or anything from the motherboard?