I definitely recommend removing the CPU cooler, cleaning off the old thermal paste, applying a nice new thin layer (don't add too much, or you will add space between cooler and cpu, causing less heat transfer). I see you're getting some from Walmart. Good stuff.
It also does look like the GPU...