Windows should load the appropriate drivers in a DOS session opened in Windows. So you should have no troubles removing the contents of your config.sys & autoexec.bat.
Look, you can worry this to death or just try it out. If you've saved the files as I advised earlier, it is very easy to...