If you aren't overclocking, the performance loss should be minimal. This is because DDR2-533 runs at the same front side bus (FSB) as the processor does, allowing it to run at a 1:1 ratio. Therefore, the performance should remain about the same.
If you are overclocking however, this will leave little or no headroom before the memory will not be allowed to run at a 1:1 ratio.
If you aren't overclocking, you can use the 533. If you are overclocking, use the 667 instead.
Best of Luck