Hardware accelerated video playback and games are the most common places a GPU will improve PC performance.
If you have integrated graphics now then adding a discrete GPU will literally reduce the workload of the CPU/APU, but not necessarily increase CPU performance, just reduce the temperature of the CPU, which can increase speeds.
I think the latest APUs from AMD incorporate heterogeneous computing in which they purposely offload tasks that are better suited for the GPU.