To be honest, refurbished products aren't too bad. They may have faced issues before, but the tech teams have fixed them to near perfection. Like Wolfshadow said, I'd opt for one if its a significantly lower price than a new similarly-configured PC.
Otherwise, I'd spring for a new PC to mitigate some risk (even new PCs can fall victim to failure). Also, keep in mind that the warranty for refurbished products are significantly shorter.