Have you had the card for long, or did you recently buy it second hand? When the drivers are not installed, the card doesn't run with all features, it will work as basic 2D adapter.
If the card is faulty, installing the drivers will make it work with all features and full speed, and it might even fail to work in 2D mode on Windows. It's an highend card and they suffer from heat and related problems, which might damage some cards beond the point that they work at all. Specially when they are few years old.
If you know the card should definetly work, try other driver versions. Latest released non-beta, latest beta, and then older non-beta versions.
The computer stays on right? So that we can rule out not having powerful enough PSU.
And your monitor supports the graphics mode you are using in Windows, for example that in the short time it works, you are able to see the picture in the resolution it's supposed to work. Initial splash screen during boot might have limited resolution.