Ok, it's a hot summer and the a/c in my computer room sucks (another issue)...
My Sapphire RX 580 Nitro+ LE is running temps on average of 45c on idle (MS Office/Firefox), gaming at 74c with peaks at 80c. Fan is peaking at only around 60%, so that suggests that I really shouldn't be too worried...