You should notice a speed difference as long as your usage puts enough load on the CPU to need an upgrade. ie. if you are encoding it will give you a boost if your sending an email then nothing.
^...and if you're gaming, it all depends on whether the CPU was bottlenecking the graphics card before (unlikely; that's a relatively decent processor).