Holy crap you are right? How do I get rid of the bloody thing, just delete it?
Yep, just delete that folder.
When you preform a windows reinstall, it installs a fresh copy of the OS and moves old data into windows.old.
Basically what happened is you didn't format you just reinstalled windows. This is normal. Next time give us more details, I could have gotten to that answer faster with details.