Solution
I always follow this general rule: worry when temps under load consistently stay above 60C, and do something drastic when it hits 70C+