Yeah, it's all fun and games until you want to do something useful with on old OS other than play an old game specifically written to run on that generation of OS.
Trying to get a modern web browser to work correctly is going to be a challenge.
Stability is just a fond memory. We take for granted how stable things are now and forget how many users had to reboot Windows several times a day because it was either malfunctioning or bog slow because they used poorly written or buggy software which tied up GDI resources and never released them.
If you want to play with some of those old versions of Windows, I highly recommend using vintage hardware from the correct time period. If that's not an option, try working with them in a virtual...