Will a gpu take some load off cpu

it depends on what apps your using. some are cpu bound others are gpu bound. if its cpu bound then theres nothing you can do other than overclocking.
if its a gpu bound apps like some games, then increasing the games image quality can reduce the load on the cpu as it will reduce the overall fps which can reduce the amount of calls to the cpu. this is very hit and miss though and wont work in every situation.

if your cpu is struggling go into your audio settings and disable the advanced features this can give you potentially another 15% of cpu usage on weaker systems.
 
Hardware accelerated video playback and games are the most common places a GPU will improve PC performance.

If you have integrated graphics now then adding a discrete GPU will literally reduce the workload of the CPU/APU, but not necessarily increase CPU performance, just reduce the temperature of the CPU, which can increase speeds.

I think the latest APUs from AMD incorporate heterogeneous computing in which they purposely offload tasks that are better suited for the GPU.