The stock cooler might be able to handle a light overclock, but the temps will probably be quite high.
Higher temps can reduce stability and will shorten your CPU's lifespan.
So no, you don't strictly need an aftermarket cooler but it is highly recommended.