Well, let me be the first to tell you that we have "multiple idiots" around here sometimes. Not that I'm saying anybody in particular is an idiot, even if they made that recommendation to you, but I'm not saying they aren't either.
Realize, undervolting is the EXACT SAME THING as overclocking, when it comes to the process involved. Because you are lowering the voltage on an existing CPU core speed/frequency it is THE SAME as if you increased the CPU core speed/frequency without increasing the voltage along with it. In a nutshell, both overclocking and undervolting require a rather lengthy verification process to ensure you are not introducing instability by running a higher frequency with a lower voltage, or at any voltage aside from the stock configuration for that matter.
In reality I can almost assure you that your problem is a combination of a case that doesn't allow for good intake by way of front fans (And I could care less about detractors who say otherwise. I'd never own a case that doesn't allow for improved airflow by way of front intake fans. A restriction is a restriction, no matter how you spin it) but more importantly the lack of even a decent entry level CPU cooler.
If you still want to go down the thorny road of undervolting, then you need to be prepared to pursue this avenue of stability testing, no different than if you were overclocking.
Quick and dirty overview of overclocking validation procedure.
Set CPU multiplier and voltage at desired settings in BIOS. Do not use presets or automatic utilities. These will overcompensate on core and other voltages. It is much better to configure most core settings manually, and leave anything left over on auto until a later point in time if wish to come back and tweak settings such as cache (Uncore) frequency, System agent voltage, VCCIO (Internal memory controller) and memory speeds or timings (RAM) AFTER the CPU overclock is fully stable.
Save bios settings (As a new BIOS profile if your bios supports multiple profiles) and exit bios.
Boot into the Windows desktop environment. Download and install Prime95 version 26.6.
Download and install either HWinfo or CoreTemp.
Open HWinfo and run "Sensors only" or open CoreTemp.
Run Prime95, either version 26.6 OR the latest version WITH the AVX and AVX2 options disabled in the settings menu that pops up when you start up Prime95, and choose the "Small FFT test option". Run this for 15 minutes while monitoring your core/package temperatures to verify that you do not exceed the thermal specifications of your CPU.
(This should be considered to be 80°C for most generations of Intel processor and for current Ryzen CPUs. For older AMD FX and Phenom series, you should use a thermal monitor that has options for "Distance to TJmax" and you want to NOT see distance to TJmax drop below 10°C distance to TJmax. Anything that is MORE than 10°C distance to TJmax is within the allowed thermal envelope. For newer Intel 12th and 13th Gen chips, Tjuncture/PROCHOT seems to be 100°C but expect to see throttling at or near that temp. IMO 95°C or lower would be a better figure to consider "max safe temp" on these CPUs and should be unrealistic with the right cooling. )
If your CPU passes the thermal compliance test, move on to stability.
Download and install Realbench. Run Realbench and choose the Stress test option. Choose a value from the available memory (RAM) options that is equal to approximately half of your installed memory capacity. If you have 16GB, choose 8GB. If you have 8GB, choose 4GB, etc. Click start and allow the stability test to run for 8 hours. Do not plan to use the system for ANYTHING else while it is running. It will run realistic AVX and handbrake workloads and if it passes 8 hours of testing it is probably about as stable as you can reasonably expect.
If you wish to check stability further you can run 12-24 hours of Prime95 Blend mode or Small FFT.
You do not need to simultaneously run HWinfo or CoreTemp while running Realbench as you should have already performed the thermal compliance test PLUS Realbench will show current CPU temperatures while it is running.
If you run the additional stability test using Prime95 Blend/Small FFT modes for 12-24 hours, you will WANT to also run HWinfo alongside it. Monitor HWinfo periodically to verify that no cores/threads are showing less than 100% usage. If it is, then that worker has errored out and the test should be stopped.
If you find there are errors on ANY of the stability tests including Realbench or Prime95, or any other stress testing utility, you need to make a change in the bios. This could be either dropping the multiplier to a lower factor or increasing the voltage while leaving the multiplier the same. If you change voltage or multiplier at ANY time, you need to start over again at the beginning and verify thermal compliance again.
A more in depth but general guide that is still intended for beginners or those who have had a small amount of experience overclocking can be found here:
*CPU overclocking guide for beginners