Hi Drew
Yes you can safely OC the FX-8350 but just how far depends which AIO water cooler and also your MB.
Do not try to OC using Windows based application. Only from Bios.
You need to establish a base line by stressing the CPU to check on temperatures and voltages before you attempt the OC which should be done in stages. Don't go MAX in one hit.
If you wish I can help with your OC.