That's a pretty dated system. Is this an OEM HP Desktop ? What would be the last BIOS version date for this PC, any ideas ? Which Power supply unit do you actually have ? List the brand/model of the PSU.
Is the PSU having enough PCI-E connectors/cables to power up any mid-range/high-end GPU ?