How are you getting the ping numbers from the game or are you doing actual ping. I would try a actual ping command in a CMD window to be sure it is not something with the browser itself causing the delays. In some ways it would be better if it was the browser causing it then you might be able to fix it.
The ping time to servers depends on the distance to the server and the path the data takes. You can not control any of that. You only option is to send your data to your ISP over the connection to your house. Your ISP as well as all the other ISP in the path will decide what path to take. Many times data does not take the most optimum path because of the contracts between different ISP and where they interconnect.
Your only option is to get a different ISP and most people can't do that. There are some so called "gamer" vpn services that purchase better paths to some of the data center location of the more popular games. These are very hard to say if they will be any benefit. You must have a good path between your ISP and one of these VPN companies, if it has some bottleneck before you get on the vpn network it may not help. VPN in theory should always increase your time because of the overhead but it does help in some cases. It is mostly used in asia where not all ISP have good access to the most direct undersea fibers.