How do you get the ping time from some game or are you using a actual ping command.
Latency is either a distance measurement or delays due to data being held in buffers. In your case it has to be your pc. A cable has no ability to hold or delay data and the data travels at some fraction of the speed of light so the difference in cable lengths is so small you almost can't calculate it much less detect it with simple software.
A ping command is very simple. Since the only difference both your machine share the same path after the router you should see this in your ping time to the router. You generally see maybe 1-3ms to the router on ethernet. If this was wifi then you can see more.
This all makes me suspect this is a game issue. Games will for example get stuck in video rendering and when they finally get out and check for the "ping" packet they blame all the delay on the network when the data has been sitting there waiting to be read.
If you see this when you compare latency between the machine when you use a actual ping command this is going to be something much more strange.