Going from a 4 core cpu to a 4 core cpu is a waste of time, not even worth mentioning money. You would go to a cpu with ht but even that is questionable depending on the price you can get it. Look how much you can get a 1230 v2 or i7 3770.
Rx 580 is not a bottleneck here. That's like saying everything is a bottleneck.