After a lot of troubleshooting, I found that it is most likely the GPU adapter cable, I see in reddit several posts complaining on how bad it is and that it is more likely to be faulty than not, so my PC runs fine with the 3080 but loses video with the 4090
I found this one, Sirlyr 12VHPWR...