So you're saying they BOTH work when by themselves?
And you also say that a 4GB and a 2GB work together?
Only put in ONE stick, go into BIOS, raise DRAM voltage + 0.05, then save and shutdown. Then try adding the second stick.
Also are the 2 RAM sticks exactly the same model?