With the relative low cost of storage, I would replace it. If it is 100% empty, simply unplug the SATA data. That is the easiest way to determine if it is affecting your system.
But unless you are using it, it shouldn't slow things down. But if you use it, chances are it will have reduced read / write rates. If it takes longer to find a file, that is slowing the system down.