Yes, uninstall with DDU first.
The reason Nvidia and AMD are able to put out unified drivers which work with a large range of GPUs, is because the driver installer detects the hardware and tweaks the settings to best use the hardware. If an older GPU is missing certain hardware, the driver will be configured to emulate that hardware in software. Slower, but it prevents the driver from crashing if the game tries to use that hardware.
If you don't reinstall, your 1070 will end up using drivers configured for a 970. And any new hardware accelerated features of your 1070 may end up being unused. The drivers will instead needlessly and wastefully emulate those features in software, because the drivers think you still have a 970 which doesn't support those function in hardware.