First I'd like to say I'm happy that the charts are finally being updated again. The guys at Tom's put in a lot of hours, and I truly appreciate all the effort. However, I'd also like to say that I think this chart is simply foundation for the next update.
Honestly, the results of the newer high end cards are far too often inconsistent. I don't want to get into the ATI vs Nvidia debate at this time. Yes, some results are most definitely flawed (like the overall score where a single GTX 280 beats dual HD4870s, even though a single 4870 usually comes close, or can sometimes even beat a GTX280). However, even GPUs of the same company display results that make no sense.
Note: I'm focusing on 1920x1200 since that can show full HD resolution (1920x1080).
Apparently according to the overall test results dual 8800GTs or two 9600GTs are better than a 9800GX2? The 9800GX2 is two slightly underclocked 9800GTXs, a card which will noticeably out perform the 8800GT and 9600GT in every benchmark that can be run.
In other tests the 8800GTS 512 in SLI beats the 8800 Ultra in SLI, and the 9800GX2. Did you know that a GTX 260 in SLI can beat a GTX 280 SLI? How about a 8800 GTS 512 being superior to a 8800GTX? Even more amazingly, two 3870s in Cross Fire will beat three or four 3870s in CF, and can actually best a 4870 in CF! Not 4850s, which are cards that stomp mud holes in the 3870, but 4870s. 70!
I just skimmed over these charts, and within seconds I found results that contradicted so many other website's tests. As well as results which are flatly opposite to Tom's own previous articles!
The abysmal results of the HD4000 series demands some kind of retest with newer drivers. I've said it before, and I'll say it again, no one wants to buy hardware based on faulty information. Spending your hard earned money buying the wrong hardware is unbelievably annoying.
Also, I agree with eliminating the CPU bottleneck. All the performance inconsistencies between GPU's of the same generation are almost certainly the result of CPU limitations. The whole point of these charts is compare the GRAPHICS power!
As it stands right now, all these tests are only truly relevant to people with the same CPU as the test rig. What if someone has a Phenom X3, or X4? Or maybe just an Athlon X2? What about the Celeron L, Pentium Dual Core, or those with lower quality Conroe cores? What if they have a Core 2 Quad, or an extreme Quad? Only those with an X6800 can find any real value in such results. My guess would be less than 1% of the readers here have that CPU!
A few people have posed the idea of an article devoted to finding the CPU bottle neck, at various performance points. I STRONGLY second such a topic! You don't need to test every single graphics card, like in this chart. Or even every CPU. Just a few well selected CPUs and GPUs. If your CPU is choking a 8800GT, then you can be pretty sure similar CPUs will choke the 8800GTS/GTX/Ultra 9800GT/GTX/GTX+ etc. I think readers (myself included) have been desperately longing for just such an article for a long time.
While on the subject of CPUs, I'd like to thank randomizer especially, for the quad vs dual link. I had no idea a stock speed Q6600 (2.4GHz) can easily match an e8400 overclocked to 3.3GHz, when running SLI or Cross Fire, in gaming performance.
Lastly, please don't update once a year. Please go back to doing regular updates like you use to. Then you can simply just add cards like the 4870X2, 9800GTX+, 8800GSO/9600GSO etc.