Welcome, Do your overclock, get a software that monitors CPU temps like CPUID HWMonitor, ThrottleStop, etc. Stress test for a few minutes with a software of your choice (Prime95, AIDA64). IF your Sustained temps are below 80c, it's a guaranteed safe. Some consider below 90c to be acceptable too.
If didn't overclock your RAM manually, it should run fine.
BTW, seriously consider using aftermarket coolers for overclocking, stock ones are barely acceptable even for normal use.
Happy Overclocking