It's a common problem with some Corsair PSUs. Motherboard connector should have a locking pin which clicks in to place when PSU 24-pin plug is fully seated, has yours locked in properly?
Wouldn't worry about it then. Push too hard and you could crack the motherboard if there's no stand-off underneath that spot, now that would be disastrous!