How are you seeing the speed while you are in the game. I assume you run a speedtest in a different windows to show the 50mbps while the game was running.
Does it actually cause you any problems. Games use very little bandwidth. You have to remember the World of Warcraft and other similar games used to run on dial up modems that were running 56kbps.