Removing the GPU does not get rid of the beep codes, and since I have a Ryzen 5 5600G with onboard graphics, the beep code almost certainly doesn't have anything to do with no GPU being active.
The manual does show what 2 short beeps mean, but I'd need to be able to see my screen to see the exact POST error. That being said, this still leaves the question of what 2 long beeps mean, which I can't find any information on anywhere. I would also like to add, after resetting the CMOS and testing each slot again, I noticed that putting either RAM stick in DIMM 1 produced 2 long beeps, however putting either of them in DIMM 2 produced 2 short beeps, still leaving the display black in both cases. And yes, the difference between the long and short beeps was very clear and distinct.
At this point, would it be reasonable to assume the motherboard is the issue? Because if it were anything else, I don't see why using DIMM 1 vs DIMM 2 would generate different beep codes, but feel free to correct me if I'm wrong about that.