As I said, it does that even if that sound card is not there. And if I were to move the soundcard to the 1x above the SSD, it would turn the SSD's 4x into a 2x. I really don't know why it does that. I mean, it's quite obviously because of the weight, as it's a 980 Ti Strix, but still, I've never seen it do that on anyone else's configuration.
Edit: I'm gonna try putting my HDD so that it's cage will act as a sort of a support for the card. It won't do much to the actual position of the card, but it will stop the gravity from bending it any further.
Edit 2: Nevermind, that won't work.
Edit 3: Managed to make it straight by tying the cables to the HDD rack with zip ties. Everything seems good now. The sound card is now slightly bent but judging from other people's experiences it can take it as it doesn't have any heat problems where it could cause it to bend even further, or have the bending dislodge the cooling, since it obviously doesn't have any cooler.