Having the same issue. I'm not sure it's the NVidia driver, but rather Windows 11 24R2.
There is a patch that was released for early access: https://nvidia.custhelp.com/app/answers/detail/a_id/5553/~/nvidia-broadcast-hotfix-for-windows-insider-build-win11-24h2
It worked for me, and then...