Yep.
If you connect to the motherboard then it will just use the iGPU in the CPU if it even has one. RYZEN CPU's for example don't have a graphics component though their APU's will. (APU is CPU + GPU).
Also, if that's a 1920x1080 resolution you are fine but if it's 2560x1440 you'd need to use DisplayPort.
(you're more than likely aware, but make sure to go to NVidia then download the latest drivers for your card and version of Windows. When installing you can do a CUSTOM install and just choose the DRIVERS and PHYSX software if you'd like. Or install everything as it probably doesn't matter.
I only use Geforce Experience to occasionally use SHADOWPLAY and record video.)
Which reminds me, I think Windows 10 sometimes has its...