My memory is rated at 667, can I OC it to 800?

Depends on the memory, some will over clock very well, some will not. I have some Patriot DDR-2 667 that runs at 800. I also have some G.Skill DDR-2 800 that runs well at 900. Mine will do this without upping the volts. See if you can find out what kind of memory you have, brand as well as specs & see if there is any info out there about them.
 
Try lower voltage. I'm running 667-rated RAM on 800 4-4-4-12 with 2.0 V, but they can get very hot. Use MemTest to check stability