That's pretty typical of a USB 2.0 connection. The only thing you can do to improve it is to make sure it's the only device connected to that particular USB hub. You can check in Device Manager, Universal Serial bus controllers, then right click on each, properties, Advanced tab, and it will show whether or not any other devices are sharing bandwidth on that hub. Even something simple like a mouse or keyboard typically reserves 20%. It isn't always immediately obvious which ports are paired on your system, I've seen a number of systems where they've paired front and back ports together.
If you're using a USB 2.0 drive on a USB 3.0 port, you don't need to worry about any other devices sharing bandwidth.