"The problem is the stupid GeForce Experience crap that runs in the background regardless if you install it or not!"
No it doesnt. You must have remnants left over from a previous install because i have installed/uninstalled GFE without even uninstalling the drivers countless times, and while GFE is indeed useless to me, it never fails to uninstall the background programs for GFE. Now, you will still have the regular GF programs running in the background (3 exe's if I remember correctly, more if you install the 3d vision drivers), but those are not GFE related.
Do a complete nvidia uninstall using the appwiz.cpl, then download the latest DDU and run it in safe mode. Then reinstall the nvidia driver package unchecking GFE and the stereoscoping drivers, and you should be fine.