If you can't tell the difference, it doesn't matter. I would say it is a design choice on how loud the front and rear audio ports are but that's just a guess. Maybe so that speakers can fine tune the volume easier? Not entirely sure.
If you're really worried about which one should sound better, plug them into the back since it would reduce the potential for electrical interference. I haven't encountered this issue before but other members have.