Speaking for experience ...
When I built my newest box, benchmarking with 3DMark using a 640 MB eVGA 8800GTS (G80 core), going from 2.4 GHz to 3.2 GHz, I noticed a mostly linear increase in frame rates. At 3.3 Ghz, the increase pretty much leveled off. 3.6 GHz gives me more CPU power, but does not measurably affect graphics performance.
At 3.6 MHz, vcore in BIOS is overvolted to 1.45 volts, drooping to 1.425 volts. Core temps after 24 hours of Prime95 is 61 C - 65 C.
The first thing that will determine how well YOUR Q6600 overclocks is the stepping (version of the CPU). The latest stepping is G0. The previous version was B3. If you bought yours recently, it's a probably a G0. (How Intel jumped from "B3" directly to "G0", I do not know. I would have thought that they'd call it "C0".)
The second thing that will ... is the VID. The VID is the stock voltage YOUR Q6600 runs at. This can vary. Lower is better. "Standard" VID is 1.35 volts, I think. Mine is 1.2625 volts. I got a pretty good one.
The third thing that will ... is the HSF you are using. As you run faster, you will need to run a higher CPU voltage. This generates heat. Heat is BAD. The better your HSF, the more heat you can get rid of. Water cooling is a whole 'nother thing.
The fourth thing that will ... is you choice of motherboards. Some motherboard are simply better overclockers than others. This is more of a "model" thing than a "brand" thing.
The fifth thing that will ... is your choice of case. Some cases are better at moving air through them than others. I have an Antec 900. 900's have many flaws but they are excellent at moving air.
The sixth thing that will ... is the air temperature (called "ambient temperature") around the PC. Air at 25 C will cool a PC better than air at 35 C.
The stock Intel HSF is actually pretty good. Assuming a decent case with good air flow and a G0 CPU, you should be able to reach 3.0 GHz. with the stock HSF. With something like an inexpensive Arctic Cooler Freezer 7 Pro, you should be able to hit 3.2 to 3.3 GHz. Any higher will require topgrade cooling - ThermalRight Ultra 120 Extreme, the newer Xigmatek HDT-S1283, or something similar and a motherboard and PSU with good, stable power.
Overclocking can gain you a substantial increase in performance, but it is not "free" performance.
Overclocking since 1978 - TRS80 Z80 from 1.77 MHz to 2.01 MHz