It depends entirely on what exactly you mean by classic gaming.
If it's something that's going to have compatibility issues on a modern operating system, it's better to do it on an old PC, or on an old operating system running in a virtual machine.
If you're talking about just old games though, from the ~2000's era, then a new PC will do just fine.