Memory speed does have a drastic affect on that CPU/APU in gaming.
If $$$ is a concern, I would change it to 8GB(For now) 3200MHz+ RAM, use the savings for a better ssd and power supply. That PSU while likely to work just fine with what you have going on, is not recommended once you add a GPU...