Ok, so just go by the manufacturer's specifications. Your card is listed at 269mm long, so now just go look up your case's maximum supported GPU length and make sure to pick out a 1080Ti that fits within that limit. If you're not 100% sure that you're looking at the right info, you'll need to list your case model as well so a suitable recommendation can be made, but as was stated above, if you're eyeballing it and you have ~5" of space left, you'll probably be ok with almost any model 1080Ti.
Also, while your PSU will be sufficient for the combination of R5 1600 + 1080Ti at stock configuration, it may be cutting it close if you decide to overclock both components. The 1080Ti alone can (depending on model) pull in 300W+ when overclocked...