Sometimes Windows allows files to be created that have illegal characters in the file names, and you cannot delete, copy, or move them from the explorer.
What you must do on this case is delete them from a Command Prompt using the short, or DOS, name.