There are lots of stops and hops in between your modem and the particular server you are connected to when gaming...
If you are certain your modem is responsible, you might have to replace the modem to prove it, as most ISPs are absolutely not concerned in the slightest with gaming ping times...; you might actually receive a replacement if your calls pertained to 'frequent internet dropouts, etc...)