It does come down to what the PC is doing with the drive at the moment it's unplugged. Nothing catastrophic should happen if the drive was idle but if it's not it's like USAFRet said. If there's important stuff on the drive, it's better to be safe than sorry.