You should pay attention to the GPU temperature though,I've seen a lot of threads about people suddenly having thermal issues with the GPU after mounting it vertically, problems they did not encounter before installing it that way.
If you have sufficient airflow, it shouldn't present a problem, lots of people don't experience any issues, but it is worth being aware of