I have a 65" Q90 Samsung and the xbox one X looks beautiful on it with really low response time and I've never noticed the 4K not looking like it should. At least in the games that I have played.
However, I actually like playing on a monitor better anyway so 27-33" is what I am looking for to answer your question