More than likely Windows is beginning to load up the desktop, and freezes before the GUI is loaded. So it could be a problem with the Windows install itself, or some other program that's loading during that process.
If this is a true "Clean" install of Windows and all you've installed are the nVidia drivers, I'd suggest formatting the hard disk and reinstalling to see if that fixes the problem. If it doesn't fix the problem, you may have a hardware related problem that's causing freezes during boot-up sometimes. This could be a CPU or RAM issue potentially. Video card problems usually manifest themselves in more visual errors.
What version of Windows is this? XP, Windows 7? Vista?