A quality 500w PSU should be able to drive an RX480 but the Corsair VS series is at the bottom end of what Corsair has to offer in terms of reliability.
I'm not saying that's definitely what's causing your problem, only that it could be. I can't come up with any other reason provided you've fitted the card firmly and properly in the slot.