Fullscreen Issues - BioShock Infinite

[CGurrell]

Ok so I've noticed for a while that my PC doesn't seem to like fullscreen games or applications (including YouTube and Netflix) very much. It tends to run these applications in fullscreen for a bit, then tab out to the desktop (Game) or go into windowed mode (Applications).

As I was recently playing BioShock Infinite, it started to exit to the desktop more frequently, when I was actually able to play, the fps I was getting was differing massively (1080p, Ultra settings with AA, I was getting anywhere between 1 and 60fps with v-sync, and up to 180 without).

I also noticed when playing BioShock Infinite that my GPUs fans started getting really loud, as well as my Disk being used at 100% (Shown in Task Manager) with System using 27.1MB/s (i think that's write but could be read).

Has anyone else had this issue and/or been able to fix it? Not just for BioShock but for all other applications too.

I should probably also mention that my GPU is overclocked (See http://gyazo.com/daf56d25bd480312f979955e840a3340), but that I was having this issue before I overclocked my GPU (And I think even before I bought this GPU but i'm not 100% on that).

Thanks guys

EDIT: I am using Windows 8.1 pro if that makes a difference

 

[CGurrell]

Is nobody else having similar issues? Or even know of a possible solution?