Yes, if you are sure, you won't be reverting to a previous build or feature update of Windows. Usually they only contain superseded system files and not anything from user data folders.
In recent Windows, those Windows.old files are supposed to be automatically deleted after ten days anyway. 10 years ago in early Windows 10 builds it was 30 days, and people still complained when they were no longer able to revert to Windows 7 or 8.1. Presumably Microsoft is more confident now that you will love it, or that later updates that break Windows will do so more noticeably so you'll know it right away.