Yes, you must uninstall old drivers
1-- Download DDU (Display Driver Uninstaller)
2-- Uninstall old drivers using DDU
3-- Shut down PC, remove old GPU then install New GPU
4-- Install new drivers from official website (Nvidia) or from CD provided with new GPU