I found a 2GB nVidia GT530 DVI / HDMI PCI-E GDDR3 for $80 that instantly worked.
The 2 GB Ati Radeon HD 7570 PCIe x 16 had a slight scratch on the board.
The machine is up and running with the new motherboard (HP 3400 MT, i5 quad core at 2.66 ghz), 300 watt power supply and the 2GB nVidia GT530.
Oh well, I understand everyone was trying to tell me to not bother by upgrading, but the spouse got a MT for cheap at work and I wanted to tweek it a bit and it was a fun challenge. Plus I didn't want her to feel that she got ripped off because we both didn't know its limitations as a bare bones machine. But swapping out the motherboard I wanted to tackle the cheapest options and I was able to motify for what it could handle.