Yes, it will play almost all games just fine. The only exception would be games that has dropped DirectX 9 support such as Just Cause 2 and the upcoming Battlefield 3. Those games can only be played on Win Vista or Win 7 since they require DX10 or DX11 to play.
Win XP only supports up to DX9 even if you install a DX11 video card.