Yes. Get a new mouse. This generally only happens when there is an issue with the mouse. It could be as simple as a piece of fuzz or whatever gets caught under the button mechanism, or crap built up inside the mouse if it's old enough. But the bottom line is, this is a hardware issue pretty much every single time. Try a different mouse. Go buy a two dollar mouse and see if it does the same thing. Honestly, pretty sure it will and this is never a Windows or OS problem.
Could, on very few occasions, be a driver issue, so make sure that if your mouse is a model with a specific Windows driver, that you have the latest version, and it also wouldn't be the worst idea to make sure that the motherboard BIOS is up to date and that the chipset driver is as well. Manually. Do not EVER rely on Windows update to be accurate when it comes to hardware drivers.