Give Rivatuner a go, the OSD will give your FPS whilst you're playing and when you close the game or alt-tab out the graph will show a trace so that you can see where the highs and lows were.
As long as it is consistent with how it effects actual FPS, then yes, it is a reliable tool for measuring the difference that changes make. Now, for comparing E-peens, not so much.