Right click on the volume icon and go to communications devices, perhaps your input gain is set low.
If the mic doesn't work on other computers as well, it might just be a broken mic. If that's the case, it's time to start considering a proper headphone with a modmic or other replaceable mic.