A few GB seems a lot. If you update using Geforce experience it should just remove and replace drivers, My Nvidia folder is 2.42gb but I wouldn't expect to gain that much back if its just replacing files.
Unless you did a custom install and only asked for certain things, then it may gain you space if you had installed them in a previous update cycle.