What exact model of PSU do you have?
The 580 8 and 1060 6 trade blows, so pick whichever you want. A 1660 or 1660ti could cause a CPU limit, especially since you can't overclock on your A320 board.
I would pick the 580 since it has more VRAM and is cheaper. Plus AMD driver optimizations over time will bump performance.