Idle temps with Ryzen are not idle temps with Intel, which has been the 'norm' for what most consider normal.
Intels chop voltages across all cores simultaneously, but all cores retain a certain amount of activity, so at idle every core has only a partial load of the background processes and services. The temp you see is the highest temp out of all the cores, which changes according to which core and when the cores are polled.
Ryzen are somewhat different. At idle, all cores except the preferred core are deactivated, asleep. They share no load, the entire background tasking is dumped on that single preferred core, so is naturally going to register as higher temp than Intel with only a partial load. The preferred core holds that load for about 3 seconds, then wakes and passes the load before being deactivated. That'll roll every core, one at a time, with load so that all cores end up seeing somewhat equal amounts of use.
So if a quad core cpu, Intel would be 30/32/30/30 for example, while a Ryzen would be looking at 24/45/24/24. The polling seeing the 32 as highest for Intel, but the Ryzen registering 45. This is completely normal Ryzen behavior, has nothing to do with whether a 5800x3D is considered 'Hot' running or not.
The job of any cooler is to moderate temps to maintain a working, stable temp within acceptable limits, and does so by changing fan speeds. It's job is Not to maintain the absolute lowest temps possible, that only happens when you manually set the fans to 100%.
Your temps are acceptable, especially concerning Prime95, since I'm going to assume you did not disable AVX technologies, which can hit an approximation of 115% cpu power load, or higher.