Sandpaper to roughen the surface is indeed an option.
Unfortunately, that option would not be easily reversed.
I suggest that you try "roughening" the surface texture with perhaps masking tape or some other easy to apply and remove material as a test to ensure that the general concept works.
May not be initially pretty per se but some experimentation may prove helpful before applying sandpaper.
Especially if the mouse is still under warranty. Sanding will likely void any warranty.