m.2 heatsink

I only have one m.2 drive and 4 places for more in the future. Do I need to remove the tape from all 4 before I turn it on? I've heard remove just because its plastic in a computer and leave alone because it won't melt and will keep it clean for future use. Or is it just preference? msi mpg z690...