Yes.
You can easily find situations where that CPU is slightly bottlenecked.
Due to the number of cores it has a base clock of 2.4GHz and Max Turbo of 3.2GHz (with say THREE cores running it might be about 2.9GHz)
If you need those threads for non-gaming then weigh your pros and cons carefully. It is however a very POOR CHOICE if being used mainly for gaming.
An i5-6600K would work better for gaming, to be clear.
Compare TOTAL vs SINGLE:
http://www.cpubenchmark.net/cpu.php?cpu=Intel+Xeon+E5-2620+v3+%40+2.40GHz
vs
https://www.cpubenchmark.net/cpu.php?cpu=Intel+Core+i5-6600K+%40+3.50GHz&id=2570
The FX-6300 can drop a game over 40% vs a good Intel CPU and it's single thread performance isn't much lower, in fact it's often overclocked to similar that of the Xeon:
https://www.cpubenchmark.net/cpu.php?cpu=AMD+FX-6300+Six-Core
Based on these numbers it's very easy to estimate 10% or greater losses in some games (vs say an i5-4690K or i5-6600K).
Summary:
I suggest paying careful attention to the numbers as they don't tend to lie. It's just not ideal for gaming. Unless you're using almost the entire processor for converting video or a similar task then it's a very poor choice of processor.