I agree, most likely effect would be causing hard drive head to skip leading to misreads or miswrites and data errors and even scratches on the disk surface. Drives these days are pretty tolerant. Probably not a problem with Solid State drives.It's possible.
I would try to stop doing that. 😉