Well to start its a Ryzen and you are thinking about Intel temps. At idle, intel only drops clocks and voltages on All cores, but All cores remain active. Then any idle background tasks are split up into all the cores, so you see low loads and low temps.
With Ryzen at idle, it shuts down all of the cores except 1. So the entire background list is on 1 core, which has a higher load and therefore higher temps. On One core.
You are used to Intel temps of the whole cpu at temp, it isn't, its just 1 core.
Take the cpu off Performance power plan, should be on Balanced.
You can set the X63 for silent mode and forget it exists. You do have CAM software? and Ryzen Master?