Yeah it's likely an airflow issue - you can also potentially buy some aluminium heat sinks to add onto the VRM components (assuming your board doesn't have any). Anything you can do to increase airflow over the components will also help a lot.
Out of interest what motherboard are you using?
One other thought is you could look at adding a discrete gpu, as that will reduce the power running through the cpu and therefore reduce the load on the VRM (as it will only be powering the cpu cores not the graphics as well). There are plenty of cards about faster than the igpu in that 3200G that shouldn't cost too much if you don't mind looking at second hand parts. Something like an RX560 or GTX 1050 series cards would probably do the trick.
I got an MSI b450m pro m2 max, cheap and easy, as I wanted this build. I'm planning to build a better pc in the future, like a 2060s or 3060 if i can, paired with a 3600x or 5600x, maybe later this year or next year.
I built this just for have a nice machine to explore the world of pc that i discovered to like a lot, but I dont think that this cpu is worth even a light upgrade like a 1050.
Dont get me wrong, this apu is an amazing package, for €95 is the best deal i've done last year, but even at 4GHz it can sometimes bottleneck its own vega 8, without fps cap on some competitive games. Thanks a lot for the advices, and sorry if I made some mistakes, my english is coming from watching LTT's, mkbhd's and dave2d's video!