I've actually tried this recently, and one major issue running any normal (and even light) distros from an usb thumb drive is that its very slow.
Even MX Linux appear slow when installed on USB thumb drive, but it works at least - other not-so-light distros may not work that well - dependent on the usb stick performance of course.
A better alternative is a system tailored for this, such as NomadBSD.