How will you see anything if you remove the graphics card?
If you are upgrading to a nvidia card, no need to do anything.
Just replace with the new card.
It should run, but you might download the latest nvidia driver regardless.
You will have a choice to do a clean install or to preserve any nvidia settings.
If you are replacing with a amd card, you should probably remove any nvidia apps.
A gpu will have a default mode that runs without any drivers at all.