Lookup CR2032 on google images, and you'll figure that part out.
You'd have to disconnect the power cord before removing it though.
And no, it wont have any impact on your data (but you'll definitely have to re-configure the date/time settings, and possibly the boot device priority as well)
But personally, I don't think this is needed at this point. From my experience, BIOS hangups = drive problems.
It could be your HDD/SSD, or Optical (CD/DVD drive), try disconnecting each of em one by one and see if the problem resolves.
You should also later on run Crystaldiskinfo to check up on your HDD's health.