Yes it's okay. The default removal policy is "Quick Removal" which disables delayed writing. As long as the drive's "busy" light is not flashing you can unplug the drive without using the "Safe Removal" icon in the notification area.
That applies to Windows, I've no idea about MacOS as I've never had a Mac, nor do I ever want one.