Any performance differences between drivers will likely only be lower single digit difference, if there is a difference. As an example, that could mean at best +/- 2-5 fps (3-9%) if 60fps is the base you get now in a game you play.
You could likely get the same or higher fps with a ram speed and timing tweak, or even more performance if you swap to dual modules for dual channel mode if you are currently using a single ram module.
I wouldn't worry about the driver versions, just use the recommended driver from the nvidia driver download page. A faster GPU would be the only real way to increase performance in a meaningful way.
*Edit* You might also have the option to upgrade the CPU to a Ryzen 5 5600X or non X (not G series or 5500) for a huge boost in CPU performance and possibly fps, if the games you're playing are CPU biased. You're still better off spending for a better GPU first for a real upgrade.